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Research  was  conducted  to  develop  a  capability  for  quantification  and  assess¬ 
ment  of  in-flight  pilot  performance  for  utilization  in  Undergraduate  Pilot  Training 
(UPT).  This  feasibility  effort  was  directed  to  overcoming  the  disadvantages  of  the 
traditional  subjective  rating  of  a  pilot  trainee's  performance  by  the  instructor 
pilot.  This  was  accomplished  through  the  development  of  an  automated,  objective 
performance  measurement  system  that  possesses  the  characteristics  of  reliability, 
validity,  and  sensitivity.  A  T-37B  was  instrumented  to  digitally  record  24  flight 
and  engine  parameters.  An- extensive  computer  software  system  was  developed  with 
which  to  calibrate,  and  analyze  the  recorded  data  from  the  lazy  8  and 

barrel  it  a  maneuvers,  and  compute  performance  measures.  Criterion  values  for  the 
two  maneuvers  were  developed  by  utilizing  task  analysis  data,  narrative  descrip 
tions,  and  recorded  in-flight  maneuver  performance  of  a  highly  qualified  Air 
Training  Co««and  instructor  pilot.,  Utilizing  recorded  data  from  16  students  and 
4  instructors,  experimental  performance  measures  were  derived  through  an  iterative 

analytic  approach.  .  . 

Study  results  indicated  that  lazy  8  performance  assessment  can  be  accomplished 

using  the  flight  parameters  of  roll  angle,  pitch  angle,  and  airspeed  in  a  single 
summary  error  measure.  Barrel  roll  measurement  is  dependent  upon  roll  and  pitch 
angle,  acceleration  (g  force),  and  roll  rate.  A  definite  relationship  between 
roll  and  pitch  was  determined  to  be  critical  to  measurement.  Discussions  of 
measurement  validation  methods,  debriefing  plots,  a  sampling  rate  study,  instrumen¬ 
tation  techniques,  and  problem  areas  are  provided.  _ 
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ABSTRACT 

Research  was  conducted  to  develop  a  capability  for  quantification 
and  assessrr-nt  of  in-flight  pilot  performance  for  utilization  in  Under¬ 
graduate  Pilot  Training  (UPT).  This  feasibility  effort  was  directed  to 
overcoming  the  disadvantages  of  the  traditional  subjective  rating  of  a 
pilot  trainee's  performance  by  the  instructor  pilot.  This  was 
accomplished  through  the  development  of  an  automated,  objective 
performance  measurement  system  that  possesses  the  characteristics  of 
reliability,  validity,  and  sensitivity.  A  T-37B  was  instrumented  to 
digitally  record  24  flight  and  engine  parameters.  An  extensive 
computer  software  system  was  developed  with  which  to  reduce,  calibrate, 
and  analyze  the  recorded  data  from  the  lazy  8  and  barrel  roll  maneuvers, 
and  compute  performance  measures.  Criterion  values  for  the  two 
maneuvers  were  developed  by  utilizing  task  analysis  data,  narrative 
descriptions,  and  recorded  in-flight  maneuver  performance  of  a  highly 
qualified  Air  Training  Command  instructor  pilot.  Utilizing  recorded 
data  from  16  students  and  4  instructors,  experimental  performance 
measures  were  derived  through  an  iterative  analytic  approach. 

Study  results  indicated  that  lazy  8  performance  assessment  can  be 
accomplished  using  the  flight  parameters  of  roll  angle,  pitch  angle,  and 
airspeed  in  a  single  summary  error  measure.  Barrel  roll  measurement 
is  dependent  upon  roll  and  pitch  angle,  acceleration  (g  force),  and  roll 
rate.  A  definite  relationship  between  roll  and  pitch  was  determined  to 
be  critical  to  measurement.  Discussions  of  measurement  validation 
methods,  debriefing  plots,  a  sampling  rate  study,  instrumentation 
techniques,  and  problem  areas  are  provided. 


iv 


AFHRL-TR- 72-6 


SUMMARY  AND  CONCLUSIONS 


PROBLEM 

Traditionally,  pilot  performance  has  been  assessed  by  an  instructor 
pilot  applying  a  subjective  rating  scale  which  places  the  student  in  one 
of  several  skill  categories.  Subjective  rating  is  largely  a  matter  of 
judgment  and  is  subject  to  many  sources  of  unreliability  and  invalidity. 

In  addition,  it  places  an  unnecessary  burden  on  the  instructor  who  must 
apply  it  in-flight,  and  provides  no  way  of  assessing  solo  performance  of 
students  or  of  pilots  transitioning  to  single  seat  aircraft.  The 
purpose  of  this  study  was  to  develop  improved  methods  of  pilot  proficiency 
assessment  which  would  produce  more  valid,  reliable,  and  sensitive 
measures  of  proficiency;  and  which  would  free  the  instructor  from 
responsibilities  associated  with  in-flight  subjective  rating,  that 
detract  from  his  attention  to  instruction  and  safety.  The  particular 
problem  to  which  the  study  was  addressed  was  T-37  pilot  performance 
measurement  in  the  Undergraduate  Pilot  Training  (UPT)  program. 

APPROACH 

The  approach  was  to  develop  and  implement  instrumentation  for 
recording  T-37  flight  data;  and  to  develop  technology  and  computer 
software  for  automatically  measuring  pilot  performance  using  the 
recorded  flight  data.  Twenty-four  flight  variables  were  recorded  at 
rates  of  10  and  100  samples  per  second  using  appropriate  sensors  and  a 
data  acquisition  system  which  encoded  the  data  in  digital  form  on 
magnetic  tape.  Software  was  developed  for  calibration  of  the  data  and 
fcr  producing  an  initial  condensed  print-out  for  purposes  of  maintaining 
a  continual  check  on  the  instrumentation.  Automated  measurement 
studies,  addressing  two  representative  maneuvers,  were  conducted  using 
the  calibrated  flight  data  recorded  for  a  number  of  students  and 
instructor  pilots.  The  approach  used  was  to  compute  measures  that  were 
initially  selected  on  the  basis  of  Air  Training  Command  maneuver  analyses 
and  which  possessed  content  validity;  then  test  and,  as  necessary,  revise 
the  measures  based  on  experience  with  the  data.  Correlation  between  the 
derived  measures  and  instructor  pilot  ratings  was  also  investigated  to 
address  inter-  and  intra-rater  reliability  and  to  identify  measures  which 


v 


AFHRL-TR-72-6 


consistently  failed  to  reinforce  the  ordering  of  performances  achieved 
by  the  rating  system. 

RESULTS 

A  summary  error  measure  for  the  lazy  8,  based  on  the  flight  parameters 
of  roll,  pitch,  and  airspeed,  was  developed.  Criteria  were  based  on 
data  from  skilled  pilots,  and  the  measure  accounted  for  67?  of  the 
variance  in  subjective  ratings  for  the  data  used  to  formulate  criteria. 

In  contrast,  no  significant  correlations  existed  between  the  measure  and 
subjective  ratings  for  student  data.  Upon  investigation,  this  was  found 
to  be  primarily  due  to  inconsistency  between  Instructor  pilots  rating 
techniques  and  standards.  Using  validation  techniques  which  do  not 
depend  on  subjective  ratings,  face-validity  of  the  error  measure  as 
applied  to  student  data  was  demonstrated.  Good  validation  was  not 
possible  due  to  lack  of  sufficient  data  per  individual  student. 

For  the  barrel  roll,  the  parameters  of  roll,  pitch,  normal 
acceleration,  and  roll -rate  were  used  as  a  data  base  for  measurement. 

It  was  found  that  the  roll /pitch  relationship  and  not  roll  or  pitch  as 
single  variables,  is  critical  to  measurement.  The  constancy  of  rol 
rate  and  maximum  excursions  of  normal  acceleration  are  also  critical. 
Considerable  difficulty  was  encountered  in  developing  criteria  for  this 
maneuver  due  to  variance  in  performance  technique. 

Debriefing  charts  were  developed  for  use  in  pictorially  describing 
the  performance  of  each  maneuver  and  conveying  measures  and  diagnostic 
comments  to  instructor  and  student.  Central  charts  for  both  the  lazy 
8  and  barrel  roll  consisted  of  plots  of  pitch  versus  roll. 

During  the  effort,  data  were  collected  on  the  lazy  8,  and  barrel 
roll  (about  160  performances  of  each),  and  seven  other  UPT  maneuvers. 

With  the  major  exception  of  ground-reference  data,  the  variables 
recorded  appear  to  form  a  sufficient  data  base  for  measurement  within 
UPT.  Techniques  were  developed  for  determining  required  sampling  rates. 
For  pitch  angle,  a  rate  of  one  per  second  was  found  to  be  adequate  for 
both  the  lazy  8  and  barrel  roll. 
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CONCLUSIONS 

This  study  achieved  its  original  goals  of  establishing  feasibility 
and  developing  prototype  techniques  for  automated  measurement.  One 
disappointing  aspect  of  the  effort  was  inability  to  adequately  validate 
results  (beyond  the  content  validity  inherent  in  the  measures)  due  to 
lack  of  sufficient  data  per  student.  Future  efforts  should  rely 
heavily  on  within-subject  sampling  for  validation  of  measures;  however, 
concurrent  validation  using  subjective  ratings  is  also  worthwhile 
investigating  so  long  as  it  is  applied  as  a  necessary  (not  sufficient) 
test  and  results  are  interpreted  with  the  cautions  identified  in  the 
report. 

The  most  surprising  aspect  of  the  study,  and  one  which  essentially 
caused  it  to  require  twice  the  time  and  effort  originally  estimated,  was 
the  level  of  effort  needed  to  acquire  and  prepare  for  use  good  in-flight 
data.  In  part  this  was  due  to  the  prototype  nature  of  the  effort,  and 

many  of  the  problems  encountered  can  be  prevented  in  future  studies. 
However,  there  are  a  number  of  types  of  problems  characteristic  of 
in-flight  data  collection  for  which  details  cannot  be  anticipated. 
Sufficient  time  and  manpower  must  be  programmed  to  take  care  of  such 
problems  on  an  as-required  basis. 

Automated  proficiency  assessment  must  be  blended  properly  with 
subjective  evaluation  of  certain  primary  skills  that  do  not  lend 
themselves  to  automated  measurement.  Such  a  system  can  provide  more 
valid  and  reliable  measurement  techniques  than  ever  before  employed. 
This  can  greatly  enhance  pilot  selection  and  training  and  will  also  lay 
the  groundwork  for  important  research  in  such  areas  as  simulator-to- 
aircraft  transfer  of  training.  Future  efforts  are  required  to  expand 
the  technology  to  other  maneuvers  in  the  UPT  curriculum  and  to  develop 
similar  techniques  for  other  aircraft. 
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SECTION  I 
INTRODUCTION 

This  report  documents  a  three-year  exploratory  development  effort  in 
the  area  of  quantitative  assessment  and  automated  measurement  of  pilot 
performance.  The  effort  involved  the  instrumentation  of  a  T-37B  aircraft, 
collection  and  calibration  of  student  and  instructor  performance  data, 
and  the  development  of  objective  measurement  techniques  for  selected 
training  maneuvers. 

The  development  of  performance  measurement  techniques  with  all  of  the 
appropriate  characteristics  (objectivity,  reliability,  etc.)  is  one  of 
those  problems  which  has  truly  withstood  the  test  of  time.  Witness  the 
following  extract  from  a  1952  technical  report  (Smith,  Flexman,  and 
Houston,  1952): 

"An  examination  of  the  training  program  and  a  survey  of 
previous  research  on  pilot  training  indicate  that,  for 
the  most  part,  objective  standards  did  not  exist  and 
that  measures  of  pilot  proficiency  were  not  sufficiently 
reliable  or  discriminating  for  use  as  effective  criterion 
measures  for  training  research." 

The  prevailing  truth  and  existence  of  statements  such  as  above  attest 
not  only  to  the  difficulty  and  complexity  of  (pilot)  performance 
measurement  as  a  research  problem,  but  also  to  recognized  importance 
over  the  years. 

The  importance  of  measurement  as  a  research  problem  is  due  to  the 
fact  that  measurement  is  a  fundamental  requirement  which  pervades  all  of 
training,  education,  and  any  associated  research.  It  is  not  possible 
to  perform  good  research  in  training  innovations,  for  instance,  unless  a 
valid  method  exists  for  measuring  the  results  of  training.  Neither  is 
it  possible  to  optimize  training  and  achieve  good  quality-control  in 
pilot  "production"  if  it  is  necessary  to  rely  on  rudimentary  subjective 
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judgments  of  performance  which  place  a  student  in  one  of  a  few  rating 
categories.  Much  training  oriented  research  of  the  future  can  benefit 
considerably  from  the  development  of  valid  performance  measurement 
techniques;  and  some  very  beneficial  research  is  strictly  dependent  on 
such  developments. 


The  above  remarks  hopefully  help  to  place  measurement,  as  a  critical 
problem,  in  its  proper  perspective.  Despite  its  criticality,  however, 
measurement  is  largely  a  means  to  many  ends  and  not  necessarily  an  end 
in  itself.  For  this  reason  it  is  too  often  treated  as  a  "nice  to  have" 
but  nonessential  ingredient  in  a  training  or  research  system,  and 
attention  is  turned  to  more  popular  endeavors  with  more  immediate  and 
visible  dividends.  The  authors  contend  that  this  is  why  the  measurement 
problem  has  persisted  over  the  years  —  not  because  it  is  unsolvable, 
and  lot  because  of  its  difficulty  in  the  context  of  complex  tasks  such 
as  flying. 

Traditionally,  in  an  introductory  section  such  as  this,  one  would 
address  in  detail  three  major  topics:  (1)  the  problem,  why  it  is  difficult 
to  solve,  and  what  characteristics  should  exist  in  a  good  performance 
measurement  system;  (2)  why  the  problem  is  important  and  what  the  many 
appl i cations  of  its  solution  are;  and  (3)  what,  if  anything,  is  different 
about  the  approach  used  in  this  study  from  all  of  the  previously  tried 
approaches.  The  first  topic  has  been  discussed  at  length  in  literally 
every  measurement  report  published,  beginning  in  the  1940  s.  (In  fact, 
in  many  reports,  discussion  of  the  problem  is  the  essence  of  the  text!) 

It  will  be  treated  only  in  summary  fashion  in  this  report. 

The  second  topic,  if  addressed  completely,  could  result  in  another 
technical  report.  The  authors  choose  to  categorize  the  applications  of 
measurement  into  two  general  classes  and  will  present  just  a  few 
representative  examples  of  each  class. 

The  third  topic,  the  approach,  covers  both  the  method  of  acquiring 
data  and  the  methods  of  treating  it.  It  is  the  latter  of  these  which 
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is  most  controversial.  The  approach  documented  in  this  report  is  only 
one  of  those  being  pursued  by  the  authors.  Therefore,  in  addition  to 
summarizing  the  approach  in  this  Introduction,  it  is  evaluated  in  Section 
VIII  and  compared  with  another,  more  highly  automated  approach. 

1 .  PROBLEM 

From  a  historical  perspective,  interest  in  the  measurement  of  the 
proficiency  of  aircrew  personnel  can  be  traced  to  the  World  War  I  period, 
and  the  work  on  the  selection  of  military  pilots.  Even  after  these  many 
years  of  endeavor,  the  measurement  and  assessment. of  in-flight  pilot 
performance  is  a  long  way  from  being  successfully  achieved,  and  less  than 
complete  information  is  provided  by  present  measures  and  methods.  The 
measurement  of  pilot  performance  is  sufficiently  difficult  due  to  the 
inherent  nature  of  the  human  and  the  environment  in  which  he  operates  that 
unfortunately,  in  many  instances,  the  practive  has  been  to  obtain  what  is 
measurable  rather  than  what  is  desired  or  required. 

There  are  tvo  general  methods  or  approaches  in  which  performance 
measurement  can  be  categorized.  The  most  common  is  the  evaluation  of 
performance  qualitatively  -  the  subjective  method.  The  second  approach 
represents  a  goal  that  is  the  subject  of  this  report,  and  that  is  the 
assessment  of  performance  quantitatively  —  the  objective  method.  These 
two  methods  are  not  strictly  a  dichotomous  classification,  but  rather 
represent  a  continuum  of  performance  measurement.  On  the  one  side  there 
exists  the  strictly  personal  judgment  and  rating  of  performance,  and  on 
the  other  end  of  the  continuum  is  a  completely  automated  performance 
measurement  and  assessment  sysxam.  The  middle  area  of  this  performance 
measurement  dimension  consists  of  var  <ous  techniques  whereby  the  human 
observer  may  record  performance  and  then  compare  this  data  with  pre- 
established  standards  to  provide  an  evaluation  of  the  quality  of 
performance.  The  desired  goal  of  an  effective  performance  measurement 
system  is  to  capitalize  on  tne  advantages  of  an  automated,  objective 
system  and  yet  retain  some  of  the  unique  capabilities  afforded  by  the 
human  evaluator  so  a  comprehensive  assessment  of  performance  can  be 
achieved. 
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a.  Requirements  of  Objective  Performance  Measurement  Systems 

The  significant  problem  in  developing  an  objective  pilot 
performance  measurement  system  consists  of  acquiring  data  and  developing 
analytic  and  software  techniques  which  derive,  from  that  data,  measures 
that  are  reliable,  valjd,  and  sensitive.  Also,  the  practical  aspect  of 
pilot  acceptability  must  be  addressed  for  such  a  system  to  be  successful. 
Each  of  these  factors  will  be  discussed  in  turn. 

(1)  Reliability 

Basically  reliability  refers  to  consistency  or  stability  in 
the  recorded  data  and  computed  measures  upon  repetition.  Reliability 
is  essential  in  both  the  acquisition  or  recording  of  performance  data  and 
in  the  measurement  of  performance  using  that  data.  When  the 
performance  of  the  same  individual  is  scored  on  different  occasions, 
reliability  is  the  opposite  of  variability. 

Several  sources  of  variability  inherent  in  customary  measurement 
situations,  which  hinder  reliable  measurement  of  pilot  performance, 
include  the  following  (Reference  1): 

1.  A  major  source  of  variability  is  a  function  of  variations  in 
the  environment  in  which  performance  is  being  measured.  Variability 
may  be  introduced  in  the  in-flight  environment  by  differences  in  traffic, 
weather,  amount  of  turbulence,  wind  direction  and  velocity,  visibility, 
etc.,  producing  "between-flying  conditions"  unreliability.  In  addition, 
situational  factors  such  as  unexpected  noise,  extreme  temperatures,  g 
forces,  and  other  distractions  may  further  affect  performance  scores. 

2.  A  second  source  of  unreliability  is  a  function  of  fluctuation 
associated  with  the  operation  of  the  system  in  which  an -individual 's 
performance  is  being  measured.  Variation  in  scores  due  to  system 
instability  may  reflect  random  fluctuations  either  in  the  mechanical 
components  or  in  other  human  components  in  the  system. 
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3.  Response-evaluating  instruments  used  and  personnel  participating 
during  proficiency  assessment  are  a  third  possible  source  of  unreliability 
The  equipment  used  during  measurement  must  be  carefully  calibrated  prior 
to  testing. 

4.  The  fourth  source  of  unreliability  is  a  function  of  the  particular 
sample  of  items  (parameters)  selected  for  inclusion  in  the  test  instrument. 

5.  The  complexity  of  the  behavior  being  evaluated  is  a  fifth  type 
of  influence  on  the  reliability  of  a  proficiency  measure.  Since  it  is 
possible  that  an  individual's  proficiency  level  may  fluctuate  considerably 
from  one  dimension  to  the  next  and  across  time,  each  component  element  in 
a  sense  represents  a  somewhat  different  test. 

6.  A  sixth  source  of  unreliability  is  attributable  to  the  change  in 
the  physiological  condition  of  the  pilot  himself.  This  includes 
emotional  state,  motivation,  susceptibility  to  fatigue  and  stress, 
variation  in  the  individual  rate  of  adaptation,  and  many  others. 

To  minimize  unreliability  in  the  data  itself,  the  hardware  and 
software  components  of  the  performance  measurement  system  require  a  high 
degree  of  reliability  or  repeatability.  Calibration  of  equipment  must 
be  conducted  on  a  continuing  basis  to  be  able  to  determine  inaccuracies 
in  the  data  or  complete  component  failure.  This  includes  checking  the 
reliability  of  the  power  supply  output,  parameter  sensor  operation 
regarding  resolution,  range  of  values,  response  rate,  and  environmental 
effects,  recording  device  operation,  and  any  interface  equipment.  The 
software  processes  involved  in  data  reduction,  conversion,  analysis,  and 
plotting  should  be  closely  monitored  to  avoid  data  loss.  Accurate 
records  of  f 1 i gh+  conditions  and  mission  requirements  should  be  maintained 
to  facilitate  the  interpretation  of  the  assessed  pilot  performance  data 
based  upon  the  actual  conditions  under  which  the  performance  was  flown 
and  recorded. 
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The  technique  of  performance  measurement,  which  develops  the  final 
measures,  must  (1)  eliminate  any  remaining  data  unreliability  and 
(2)  produce  reliable  measures.  There  is  no  standard  technique  for 
eliminating  data  unreliability  because  each  case  must  be  treated 
individually  depending  on  the  source  of  unreliability.  One  example  is 
in  the  recording  of  normal  acceleration  (g  force)  using  an  accelerometer. 
The  data  are  not  reliable  indicants  of  sustained  acceleration,  which 
would  expectedly  be  the  focus  of  interest.  Even  with  filtering,  the 
recording  would  pick  up  some  instantaneous  efr&ts  of  gust  loading. 
Therefore  it  would  not  be  acceptable  to  sample  this  data  at  discrete 
points.  Instead  some  method  of  smoothing  should  be  applied  to  the  data 
through  the  development  of  appropriate  software. 

Of  primary  importance,  ultimately,  the  measures  that  are  developed 
must  be  reliable  indicies  of  performance.  One  example  of  when  reliability 
would  not  be  assured  is  if  unrealistic  criteria  were  applied.  A 
derived  measure  may  be  considered  reliable  in  that  it  consistently 
reflects  a  comparison  with  the  criteria;  but  it  could  be  an  unreliable 
(and  invalid)  index  of  performance  due  to  the  inappropriateness  of  the 
criteria.  Without  proper  precautions,  it  is  entirely  possible  to 
induce  unreliability  in  the  measures  themselves  through  improper 
treatment  of,  what  is  otherwise  reliable,  performance  data. 

(2)  Validity 

This  refers  to  the  degree  to  which  the  measuring  or  testing 
process  correctly  measures  the  variable  intended  to  be  measured. 

Validity  can  be  categorized  into  various  kinds,  but  the  one  that  is 
most  appropriate  to  the  problem  of  in-flight  pilot  performance  measure¬ 
ment  is  empirical  validity.  Essentially,  this  is  based  upon  the 
relation  between  performance  scores  and  a  criterion,  the  latter  being 
a  direct  indication  of  performance  goals.  Criterion-referenced 
proficiency  measures  permit  assessment  of  performance  and  provide 
information  on  the  degree  of  competence  considered  independently  of  the 
performance  of  others.  Such  measures  permit  one  to  determine  whether  an 
individual  has  reached  a  given  performance  standard,  hence,  the  term 
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absolute  scoring  is  sometimes  applied.  Performance  is  measured 
against  a  definitive  task  specification  that  has  previously  been 
determined  either  by  analysis,  subjective  judgments  by  a  panel  of 
experts,  or  numerous  successful  performances,  sampled  from  large 
population. 

In  addition  to  a  criterion-referenced  measure  or  performance  standard, 
proficiency  measures  can  also  be  distinguished  as  norm-referenced 
measures.  A  norm-referenced  proficiency  measure  evaluates  an  individual's 
proficiency  in  terms  of  a  comparison  between  his  performance  and  the 
performance  of  other  members  of  the  group.  Norm-referenced  measures 
can  be  considered  a  relative  scoring  method  since  they  are  related  to 
level  of  performance  at  a  selected  moment  in  time  during  the  process  of 
learning  a  specified  task.  Such  measures  are  of  limited  value  in 
measurements  intended  for  quality  control,  because  they  are  not  referenced 
to  fixed  performance  standards.  However,  by  employing  an  objective 
measurement  system,  norm-referenced  measures  may  be  of  significant 
training  value  for  improving  the  student's  performance  through  more 
feedback  via  class  competition.  Also,  the  average  class  performance 
can  be  readily  determined  with  a  norm-referenced  measurement  system. 

An  automated  performance  measurement  system  inherently  permits  the 
assessment  of  pilot  performance  to  be  highly  valid,  since  performance 
can  be  recorded  on-line  for  numerous  system  variables.  In  most  in-flight 
evaluations,  performance  data  is  seldom  recorded  until  the  flight  has 
been  completed,  which  introduces  inaccuracy  simply  due  to  the  inability 
of  the  individual  to  remember  features  of  performance  relevant  to 
success.  Furthermore,  greater  detail  regarding  the  performance  is 
afforded  with  an  automated  system  since  more  flight  parameters  can  be 
recorded  and  more  data  accrued  per  unit  of  time  than  is  possible  with 
human  observation.  Because  of  multi-dimensional  role  of  the  instructor 
in  the  in-flight  training  environment,  a  serious  difficulty  can  frequently 
occur  whereby  the  instructor's  ability  to  detect  and  assess  subtle 
differences  in  performance  when  they,  in  fact,  exist  is  jeopardized. 
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(3)  Sensitivity 

The  reliability  with  which  and  method  by  which  a  measure  changes 
whenever  the  pilot's  performance  changes  is  known  as  measurement 
sensitivity.  This  fundamental  requirement  for  an  objective  pilot 
performance  measurement  system  pertains  to  the  fact  that  performance 
should  be  discriminated  into  as  many  categories  of  proficiency  as  possible 
(Whenever  feasible,  continuous  measures  of  performance  should  be 
obtained),  and  the  rate  of  change  of  the  measures  with  respect  to  skill 
acquisition  must  be  known.  Thus,  the  sensitivity  of  the  measurement 
system  relates  to  (1)  the  resolution  capability  of  the  sensors  to 
discriminate  each  parameter  into  values  that  meaningfully  reflect  pilot 
performance  and  (2)  the  development  of  measures  to  an  acceptable 
measurement  scale;  i.e.,  interval  scale. 

(4)  Acceptability 

Pilot  acceptability  becomes  a  rather  important  factor  when  the 
time  arrives  for  making  the  decision  to  implement  an  automated  pilot 
performance  measurement  system  that  has  been  proved  to  possess  reliability, 
validity,  and  sensitivity.  Too  often,  concern  is  expressed  that  the 
instructor  pilot  will  be  replaced  in  the  training  environment  by  an 
automated  device.  However,  whatever  the  level  of  sophistication  of 
automated  performance  measurement,  the  human  observer  must  always  be  an 
integral  part  of  the  total  measurement  system.  In  the  complexity  of 
flight  environment,  there  are  specific  behavioral  skills  which  do  not 
lend  themselves  to  quantification  or  objective  scoring.  It  is  in  these 
areas  where  the  human  observer  can  make  more  subtle  judgments  and  more 
apppropriate  evaluations  than  is  possible  with  any  electromechanical 
device. 

At  least  the  following  behavioral  factors  should  and  will  continue 
to  be  evaluated  by  the  instructor: 

1.  decision  making  capability 

2.  ability  to  plan  effectively 


8 


AFHRL  TR-72-6 


3.  coordination  and  smcothness  of  control 

4.  maturity  —  willingness  to  accept;  responsibility,  ability  to 
accomplish  objectives,  judgment,  and  reactions  to  stress,  unexpected 
conditions,  and  aircraft  emergencies. 

5.  confidence  —  proportionate  with  the  Individ;1  i 1  level  cp 
competency 

6.  motivation  (attitude)  --  the  manner  in  wnich  it  afi -act's 
performance 

7.  ability  to  time  share  attention  and  efforts  ouriately  in 
an  environment  of  simultaneous  activities 

8  coordination  with  other  crew  members 

9.  knowledge  and  systematic  performance  of  tasks 

10.  fear  of  flying 

11.  motion  sickness 

12.  air  discipline  —  adherence  to  command  authority  and  assigned 
tasks. 


The  presence  of  an  instructor  is  required  and  recommended  for  in¬ 
flight  training  and  evaluation.  The  judgment  of  the  instructor 
regarding  the  student's  total  flying  capability,  however,  can  be 
supported  by  the  objective  assessment  of  psychcmotor  skills  with  an 
in-flight  pilot  performance  measurement  system. 

b.  Applications 

The  applications  possible  for  an  automated,  objective  pilot 
performance  measurement  system  can  be  categorized  in  two  c1 asses; 

(1)  applications  which  enhance  flying  training  in  its  operational 
context;  and  (2)  applications  which  make  research  possible. 
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(1)  Operational  Flying  lraimtiu 

F-i ve  examples  of  how  operational  flying  training  can  be 
enhanced  with  an  automated  measurement  system  are  discussed: 

(a)  Inflight  evaluation  enhanced 

Tne  aircraft  is  a  prime  example  of  a  complex  system  where 
the  large  number  of  interacting  elements  lessens  the  chances  of  deriving 
reliable  and  easily  interpretable  performance  measurement  data.  The 
dynamics  of  ihe  in-flight  environment  and  complexity  of  flying,  involving 
a  large  number  of  procedural,  judgmental,  and  perceptual -motor  activities, 
imposes  a  tremendous  burden  upon  the  instructor  to  assimilate  and 
synthesize  the  student's  performance  and  provide  a  reliable  and  valid 
evaluation.  Any  attempt  at  manual  recording  procedures  is  fruitless 
since  the  instructor  is  unable  to  effectively  time-share  the  activities 
of  observing  and  recording  multiple  parameters  at  an  adequate  sampling 
rate  and  accuracy  to  provide  the  necessary  pi  loo  performance  measurement 
data.  There  are  many  subtle  aspects  of  flying  which  do  not  lend 
themselves  to  recording,  and  automated  performance  measurement  systems 
normally  permit  assessment,  of  only  those  actions  by  the  pilot  which 
result  in  some  effect  on  the  aircraft.  This  permits  the  instructor  to 
concentrate  on  the  evaluation  of  those  qualitative  behaviors  reflecting 
on  the  student's  ability  to  effectively  and  safely  cope  with  the  flight 
environment. 

(b)  Objectivity  Achieved 

In  subjective  evaluations,  considerable  variation  occurs 
*in  the  performance  ratings  of  the  instructors  as  a  function  of: 

(1)  judgments  made  without  reference  to  a  definitive  standard  since  the 
same  maneuver  may  be  flown  satisfactorily  in  a  number  of  different  ways, 

(2)  different  standards  of  performance  which  are  employed  due  to 
differences  in  the  instructor's  knowledge  and  proficiency,  (3)  operational 
flight  experience  and  training  affecting  the  perspective  and  judgment  of 
instructor  ratings,  (4)  performance  ratings  relating  to  what  the 
instructor  deems  are  the  critical  aspects  of  the  job,  (5)  possibility 
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of  bias  and  halo  effects  existing  from  the  instructor-student  relation¬ 
ship,  (6)  different  conception  of  the  specific  grading  system  regarding 
the  flight  parameters  incorporated,  weighting  assigned,  and  the  range  of 
the  qualitative  categories,  and  (7)  difficulty  of  comparing  actual 
performance  with  what  the  average  proficiency  level  should  be  at  any 
moment  in  time.  Subjective  measures  generally  lack  the  accuracy 
and  reliability  needed  for  effective  performance  measurement  because  of 
their  dependence  upon  the  judgment  and  veracity  of  the  individual 
observer.  The  antithesis  of  this  is  an  objective  measure  that  is  founded 
on  data  that  is  free  from  personal  and  emotional  bias.  The  greatest 
objectivity  is  attained  when  a  permanent  record  of  behavior  is  obtained 
at  the  time  of  performance  by  an  automated  data  acquisition  system. 

(c)  Training  Facilitated 

An  automated  performance  measurement  system  relieves  the 
instructor  of  the  burden  of  in-flight  evaluation,  and  permits  him  to 
concentrate  on  the  job  for  which  he  is  most  professionally  qualified, 
teaching  flying.  The  instructor  can  devote  complete  attention  to 
developing  the  procedural,  judgmental,  and  perceptual -motor  skills  in 
the  student  during  the  flight,  which  maximizes  the  effectiveness  of  the 
training  sortie.  Additionally,  the  aspect  of  flight  safety  is  enhanced 
by  reducing  the  in-flight  tasks  of  the  instructor  and  possibly 
eliminating  the  requirement  for  the  "head-in-the-cockpit"  situation. 

(d)  Playback  Capability  Provided 

Automated  performance  measurement  also  provides  the  means  for 
playback  of  critical  mission  phases  for  demonstration  and  instructional 
purposes.  This  playback  capability  can  be  performed  in  the  simulator 
and  even  correlated  with  earlier  simulator  or  aircraft  missions. 
Furthermore,  it  is  an  excellent  method  for  quantifying  the  rate  of 
learning  and  affording  the  opportunity  to  diagnose  consistent  weaknesses 
in  performance. 

(e)  Solo  Performance  Assessed 

It  is  also  possible  to  record  pilot  performance  during  solo 
flights,  which  provides  the  instructor  a  method  whereby  he  can  maintain 
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continuity  and  assess  the  stability  of  performance  across  dual  and  solo 
flights.  Without  an  automated  measurement  system  of  the  type  developed 
in  this  study,  it  is  not  possible  to  assess  solo  performance,  even  though 
it  is  an  important  criterion.  This  would  include  performance  in  single¬ 
seat  aircraft  (e.g.,  A-70)  as  well  as  regular  student  solo  performance  in 
training  aircraft.  In-flight  recording  and  subsequent  automated 
measurement  of  solo  performance  will  enhance  both  basic  pilot  training 
and  transition  training  by  providing  the  first  and  only  means  of  measuring 
performance  of  this  type. 

(2)  Research 

Following  are  selected  examples  of  capabilities  and/or  new  knowledge, 
the  research  and  pursuit  of  which  will  be  greatly  enhanced  when  sensitive, 
objective  measurement  systems  are  developed: 


1.  Replacement  of  highly  sophisticated  and  expensive  simulators 
with  lower  fidelity  and  less  costly  simulators  and  trainers  by  having  the 
capability  to  definitively  assess  the  transfer-of-training  effects 
(simulator  to  aircraft)  with  regard  to  the  factor  of  simulator  fidelity. 
For  example,  it  would  be  possible  to  determine  if  six  dtgrees-of-freedom 
motion  systems  and  full  color  and/or  field-of-view  visual  systems 
contribute  sufficiently  to  transfer-of-training  to  be  cost  effective. 

2.  Replace  more  aircraft  time  with  simulator  time,  and  know 
the  resulting  effects  on  training. 

3.  Develop  adaptive  training  methods  (impossible  without 
performance  measurement). 

4.  Develop  completely  automated  simulator  instruction  for  use 
in  proficiency  training. 

5.  Accurately  predict  operational  and  combat  performance  of 
pilots  based  upon  their  in-training  performance. 

6.  Improve  pilot  trainee  selection  and  reduce  the  wash-out 

rate. 
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c.  Immediate  Application  and  Program  Genesis 

The  need  for  objective  performance  measurement  has  been  recognized 
and  continually  advocated  by  the  Air  Force,  one  of  the  largest  agencies  in¬ 
volved  in  pilot  training.  The  recognition  of  this  requirement  culminated  in 
a  research  request  (RTR-68-25-A)  directed  to  the  Advanced  Systems  Division 
of  the  Air  Force  Human  Resources  Laboratory  (AFHRL)  at  Wright-Patterson 
AFB,  Ohio,  by  the  Air  Training  Command.  A  research  project  was  initiated 
in  1968  entitled  Pilot  Performance  Measurement  System  to  develop  an 
in-flight  data  recording  system  and  a  ground-based  automated  performance 
assessment  capability  for  utilization  in  UPT. 

2.  APPROACH 

The  objective  of  this  research  effort  was  to  develop  prototype  methods 
for  quantitative  assessment  and  automated  measurement  of  pilot 
performance.  The  approach  to  achieving  this  objective  was  to  (1)  develop 
methods  of  acquiring  reliable  and  accurate  in-flight  performance  data; 

(2)  develop  methods  of  measuring  pilot  performance  using  the  acquired 
data;  and  (3)  perform  preliminary  tests  of  the  derived  methods.  In 
scope,  the  acquisition  of  in-flight  data  was  designed  to  be  applicable  to 
all  in-flight  performance,  but  investigation  of  methods  for  measuring 
performance  using  the  data  was  limited  to  two  representative  maneuvers: 
the  l*zy  8  and  the  barrel  roll. 

Before  describing  the  approach  in  more  detail,  it  is  appropriate 
and  necessary  to  define  and  clarify  the  term  "performance  measure"  as 
used  within  the  framework  of  this  study: 

A  performance  measure,  as  the  term  is  used  in  this  report,  is  a 
number  that  is  selected  from  or  computed  from  recorded  performance  data, 
and  which,  in  itself,  effects  a  comparison  or  directly  contributes  to 
the  drawing  of  a  comparison  between  (1)  actual  performance  and  a 
standard  or  criterion;  or  (2)  actual  performance  and  the  normative 
performance  of  a  selected  population. 
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Recorded  in-flight  data  do  not  necessarily  constitute  performance 
measures.  Similarly,  the  act  of  recording  in-flight  data  does  not 
constitute  the  measurement  (assessment)  of  performance. 

With  these  introductory  remarks,  we  will  next  describe  in  outline 
form  the  approach  that  was  pursued  in  this  study.  The  approach 
consisted  of  accomplishing  the  following  tasks: 

1.  Developing  hardware  and  software  required  for  acquiring  and 
calibrating  in-flight  pilot  performance  data. 

2.  Developing  performance  measurement  techniques  and  implementing 
them  in  software. 

3.  Collecting  extensive  data  on  the  lazy  8  and  barrel  roll  and 
some  representative  data  on  other  maneuvers. 

4.  Testing  the  measurement  techniques. 

Each  of  these  tasks  will  be  discussed  in  turn. 

Acquisition  and  Calibration  of  In-Flight  Performance  Data.  This 
required  the  development  of  hardware  and  software  subsystems.  From  a 
hardware  standpoint,  a  T-37  aircraft  was  instrumented  to  record  a 
number  of  flight  and  engine  variables,  such  as  roll  angle,  pitch  angle, 
stick  position,  RPM,  airspeed,  altitude,  and  heading.  This  required 
the  installation  and  calibration  of  a  digital  flight  recorder  system 
and  parameter  sensors  such  as  gyros,  tranducers,  accelerometers,  and 
potentiometers.  In  addition  to  initial  installation  of  the  instrumen¬ 
tation  package,  numerous  modifications  were  completed  during  the  first 
several  months  of  use  as  problem  areas  were  revealed  regarding  flight 
safety,  electrical  power  distribution,  resolution  of  recorded  variables, 
and  recording  reliability. 

From  a  software  standpoint,  computer  programs  were  written  to 
(1)  convert  the  aircraft  magnetic  tape  to  a  tape  physically  compatible 
with  data  processing  equipment;  (2)  calibrate  the  data,  or  convert  it 
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to  engineering  units;  (3)  produce  a  magnetic  tape  record  of  tne 
calibrated  data  for  use  in  the  measurement  research;  and  (4)  produce  a 
condensed  print- out  of  the  data  for  use  in  testing  the  accuracy  and 
reliability  of  the  in-flight  recording  system. 


Development  of  Performance  Measurement  Techniques.  This  required 
the  identification  performance  measures  arid  the  development,  test’ng, 
and  print-out  of  the  measures  using  the  recorded  data.  The  approach  to 
accomplishing  this  was  to  fl)  analyze  each  of  the  maneuvers  to  be 
measured,  with  particular  attention  to  the  ATC  published  criteria  for 
performance;  (2)  develop  a  set  of  theoretical  measures  based  solely 
upon  the  information  in  the  maneuver  analyses;  (3)  compute  the 
theoretical  measures  for  initial  representative  performances;  (4)  using 
the  initial  data,  develop  a  refined  set  of  measures,  called  experimental 
measures  herein,  for  application  to  a  broad  spectrum  of  student  and 
instructor  performances;  and  (5)  test  the  validity  of  the  experimental 
measures  and,  from  them,  select  final  measures  for  future  applications. 

This  approach  is  called  (by  the  authors!  an  "analytic"  approach 
because  it  is  based  strongly  on  detailed  analyses  of  the  maneuvers  to 
be  measured.  During  the  period  of  the  program,  an  alternative  approach 
that  is  more  highly  automated  was  pursues  under  contract  using  some  of 
the  same  data  collected  in  this  investigation.  For  this  reason,  the 
data  collection  effort,  to  be  described  next,  was  responsive  to 
contractual  requirements  fn  support  of  the  alternative  approach  as  well 
as  to  the  central  requirements  of  the  study  as  reported  in  this  document. 


Data  Collection.  The  data  collection  was  pursued  in  three  phases. 
Phase  1  consisted  of  collecting  data  to  establish  and  verify  the 
accuracy  and  reliability  of  the  in-flight  data  acquisition  and  ground- 
based  data  calibration  systems.  For  this  phase,  specific  performance 
requirements  were  outlined  based  on  the  oaranet  '*'?  to  b‘  *esa.ed  during 
each  flight.  Flight  test  pilots  then  f>w  ter  ties  in  accordance  with 
the  outlined  requirements. 
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Phase  2  was  devoted  to  collection  of  data  which  supported  related 
contractual  requirements  as  well  as  the  requirement  for  representative 
instructor  pilot  (I*3)  data  for  this  study.  For  this,  a  highly  qualified 
IP  from  the  ATC  Pilot  Instructor  Training  (PIT)  school  flew  a  number  of 
lazy  S's  and  barrel  rclis  and  provided  subjective  ratings  for  each 
performance.  As  per  request,  he  attempted  to  fly  a  variety  of 
performances  to  illustrate  perfect  performance  as  well  as  typical  student 
errors  encountered  during  this  maneuver. 

Pnase  3  was  to  collect  data  on  students  and  instructor  pilots  at 
Williams  AFG,  Arizona.  This  data  was  required  primarily  to  test  and 
validate  measures,  as  described  below. 

Testing  the  Measurement  Techniques.  Content  validity  was  built  in  to 
the  measures  initially  selected  for  investigation  as  a  result  of  the 
selection-method  employed  (i.e..  Air  Training  Command  training  and 
evaluation  criteria  and  maneuver  analyses  served  as  the  bases  for 
selection).  While  content  validity  is  a  useful  and  necessary  consideration, 
it  is  not  an  apriority  that  it  is  sufficient  in  itself.  Therefore,  a 
number  of  supplemental  validation  techniques  that  are  more  empirical  in 
nature  were  also  considered. 

One  technique  that  constituted  part  of  the  original  study  design  was 
to  employ  wi thin-subject  sampling  and  examine  "measure-progress"  across 
training.  This  would  provide  an  additional  necessary  (but  not  sufficient) 
validation  test  in  that  candidate  measures  consistently  exhibiting  zero 
or  negative  "slope"  when  plotted  against  trial -number,  for  example, 
would  be  highly  subject  to  question.  Conversely,  those  exhibiting 
opposite  characteristics  would  still  be  considered  likely  candidates. 

Due  to  problem?  discussed  elsewhere  in  this  report,  sufficient  data  per 
student  were  not  collected  to  permit  pursuit  of  this  test. 

An  alternative  supplemental  method  that  was  applied  in  this  study  is 
that  of  investigating  concurrent  validity,  which  means  comparing  the 
experimenta1 ly  derived  measures  with  some  other  direct  and  independent 
measure  of  proficiency.  Again,  within  the  context  of  the  subject  at 
hand,  this  validation  rethcd  must  be  considered  as  another  necessary 
(with  qualifications)  but  ret  sufficient  test.  The  reason  for  this  is 

that  although  an  <nd>  en.icnt  measure  of  proficiency  in  UPT  is  readily 
available,  it  's  n  as  discriminating  (sensitive)  as  the  measures  to  be 

developed;  and,  since  it  is  bared  on  human  judgment,  its  reliability  must 
he  considereci  subject  to  question. 
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The  Independent  measure  most  readily  available  for  use  is  the  instructor 
pilot's  rating  of  performance,  generated  on  a  four-point  scale  (excellent, 
good,  fair,  unable).  Because  of  the  properties  of  these  ratings,  as 
outlined  in  the  preceding  paragraph,  their  utility  within  the  context  of 
concurrent  validation  is  limited  to  distinguishing  between  new  experimental 
measures  which  (a)  tend  to  reinforce  the  ordering  dictated  by  the  ratings, 
and  therefore  should  definitely  be  considered  further,  and  (b)  consistently 
do  not  reinforce  the  ordering,  and  therefore  should  be  considered  highly 
subject  to  question. 

In  this  report,  concurrent  validation,  in  the  context  described  above, 
is  explored  by  analyzing  correlations  between  potential  quantitative 
measures  and  instructor  pilot  ratings.  Summarily,  this  analysis  serves 
several  useful  functions:  (1)  it  provides  a  preliminary  foundation  for 
investigating  inter-  and  intra-rater  reliability;  (2)  it  provides  data 
which  contributes  to  validity  considerations  by  flagging  measures  which 
should  be  considered  highly  questionable;  and  (3)  it  provides  a  basis 
for  demonstrating  where/when  derived  measures  do  and  do  not  reinforce  the 
ordering  achieved  by  the  existing  ATC  rating  system.  (In  this  last  regard, 
where  derived  measures  do  not  reinforce  the  ratings,  other  supplemental 
validation  methods  that  are  applied  should  ultimately  be  used  to  prove 
the  derived  measures  are  "correct"  —  if  only  for  instructor  and  Command 
acceptance  of  the  new  system.) 

3.  REPORT  OUTLINE 

In  this  report,  the  four  tasks  briefly  described  above,  are  presented 
in  the  order  listed.  Sections  II  and  III  present  the  hardware  and  software 
subsystems  developed  for  data  acquisition  and  calibration,  and  the  initial 
tests  performed  on  the  system.  Section  IV  presents  a  sampling-rate  study 
done  to  establish  methodology  for  empirically  determining  required 
recording  rates.  Section  V  describes  the  development  of  performance 
measures  and  measurement  techniques  to  be  applied  and  tested.  Section  VI 
describes  the  scope  of  and  methods  employed  in  data  collection.  Section  VII 
describes  the  analyses  and  tests  performed  on  the  measurement  techniques 
and  presents  the  results  derived.  The  last,  Section  VIII,  summarizes  the 
findings. 

For  the  casual  reader  Interested  in  a  good  overview  of  the  research 
effort  at  the  expense  of  all  details,  it  is  recommended  that  attention 
be  focused  on  Sections  II,  III,  VII,  and  VIII. 


17 


AFHRL-TR-72-6 


SECTION  II 

AIRBORNE  DATA  ACQUISITION  SYSTEM 


1.  T-37B  AIRCRAFT 

A  T-37B  aircraft  with  a  USAF  tail  number  of  58-1948  (hereafter 
referred  to  as  948)  was  bailed  to  the  Air  Force  Systems  Command  (AFSC) 
by  the  Air  Training  Command  (ATC)  to  support  the  research  requirements 
of  the  AFHRl  Pilot  Performance  Measurement  System  Program. 

a.  Aircraft  Description 

The  T-37B  is  a  low-wing,  twin-engine  jet  trainer  with  side-by- 
side  seating  (student  pilot  flys  from  the  left  seat).  Manufactured  by 
Cessna,  the  aircraft  has  a  gross  weight  of  6600  pounds  and  an  internal 
fuel  load  for  a  normal  training  mission  duration  time  of  1  hour  15  minutes. 
The  aircraft  includes  full  instrumentation  for  IFR  flight.  Figure  1 
represents  the  cockpit  arrangement  of  948.  The  dual-control  flight 
control  system  is  manually  operated  with  an  electrical  trim  tab  system 
for  the  ailerons,  elevator,  and  rudder.  The  aircraft  has  full 
aerobatic  and  SDin  capability  with  a  g-load  limitation  of  +6.67  and 
-2.67  g's.  (A  +4g  limitation  was  imposed  during  a  large  percentage  of 
the  research  program  flights  due  to  structural  problems  in  the  T-37  fleet.) 
Airspeeds  for  the  aircraft  are:  takeoff  at  90  knots;  a  maximum  of 
382  knots;  a  final  approach  speed  of  100  knots;  and  a  touchdown  speed 
of  75-80  knots.  Some  of  the  noteworthy  operational  features  the  T-37 
affords  are  excellent  out-of-the-cockpit  visibility,  good  handling 
characteristics,  and  high  reliability. 

b.  Role  of  T-37  in  UPT 

The  T-37  has  proved  to  be  a  valuable  training  vehicle  in 
Undergraduate  Pilot  Training  (UPT).  Introduced  into  the  Air  Force 
primary  flying  training  program  in  1957,  UPT  students  fly  the  T-37  for 
approximately  90  hours.  The  performance  and  handling  characteristics  of 
the  T-37  provide  an  excellent  medium  through  which  UPT  students  can 
progress  from  a  low-performance  and  a  simple-mission  aircraft  (T-41)  to 


18 


AFHRL-TR-72-6 


a  high-performance  and  more  operationally  oriented  mission  aircraft 
(T-38A) . 

Utilized  principally  for  contact  (VFR)  flying  training,  basic 
instrument  training,  and  some  navigation  and  formation  flying,  the  T-37 
flying  training  curriculum  outlines  a  total  of  68  sorties  (55  dual, 

13  solo).  The  contact  phase  of  the  T-37,  with  which  this  research 
program  was  solely  concerned,  specifies  that  42  sorties  (29  dual,  13  solo) 
will  be  flown  in  54.7  hours.  The  instructional  units  contained  in  the 
contact  phase  include:  aircraft  familiarization,  fundamental  maneuvers 
(stalls,  spins,  traffic  pattern),  supervised  solo  flights,  area  checkout, 
advanced  (arobatic)  maneuvers,  night  flying,  and  check  flights. 

The  role  of  the  T-37  in  UPT  is  presently  undergoing  minor  revision 
through  a  reduction  in  emphasis  and  the  number  of  flying  hours  in  specific 
areas  of  the  UPT  curriculum. 

c.  Flight  Test  Support 

In  May  1968,  the  T-37  (948)  was  transferred  to  Wright- 
Patterson  AFB,  Ohio,  and  placed  under  the  operational  control  of  the 
Directorate  of  Flight  Test  of  the  Aeronautical  Systems  Division 
(currently  designated  the  4950th  Test  Wing).  Flight  Test  responsibilities 
for  supporting  the  aircraft  and  the  research  program  included: 

1.  Assigning  a  Test  Director  to  coordinate  all  Flight  Test 
support  agencies  and  AFHRL  research  requirements  with  regard  to  the 
instrumented  aircraft. 

2.  Engineering  design,  installation,  calibration,  and 
maintenance  of  the  data  acquisition  system. 

3.  Maintenance  for  the  T-37  aircraft. 

4.  Providing  a  qualified  test  pilot  and  a  scheduling  service 
for  the  equipment  calibration  and  data  collection  flights. 
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5.  Computer1  data  reduction  support  by  processing  the  one  inch 
aircraft  magnetic  tape  and  producing  a  one-half  inch  IBM  compatible  tape. 

6.  Photographic  documentation  of  the  project. 

7.  kadar  flight  following  during  the  missions. 

2.  AIRCRAFT  INSTRUMENTATION 

The  T-37  948  was  instrumented  with  a  data  acquisition  system  by 
Flight  Test  at  Wright-Patterson  AFB.  This  equipment  installation  was 
considered  to  be  a  Class  II  modification,  which  is  a  temporary  change  to 
the  standard  configuration  of  an  aerospace  vehicle  that  is  essential  to 
the  successful  accomplishment  of  research,  development,  test,  and 
evaluation  (RDT&E)  program  in  compliance  with  AFR  80-14  and  AFSCR  80-23. 
However,  the  Class  II  modification  did  not  place  any  restrictions  upon 
the  operational  capability  of  the  aircraft  with  regard  to  IFR  flight, 
aerobatic  maneuvers,  or  other  UPT  training  maneuvers.  All  engineering 
design,  installation,  maintenance,  flight  safety,  and  quality  control 
functions  were  accomplished  in  the  same  manner  as  if  the  data  acquisition 
system  were  a  permanent  installation  in  948. 

a.  Recorded  Parameters 

Upon  activation  by  the  instructor  pilot,  the  data  acquisition 
system  recorded  pilot  performance  on  17  continuous  and  7  discrete  flight 
and  engine  parameters.  An  additional  8  parameters  were  obtained  via 
computational  techniques  from  the  24  recorded  parameters.  Table  I 
provides  (1)  a  listing  of  each  of  the  32  recorded  and  computed  parameters, 
(2)  the  aircraft  component  or  system  from  which  the  recorded  values 
originated,  (3)  the  sersor  that  converted  the  various  forms  of  flight 
or  engine  data  into  the  correlated  changes  in  electrical  output  to  the 
magnetic  tape  recorder,  (4)  the  range  of  values  for  each  recorded 
parameter,  (5)  sampling  rate  that  the  data  was  recorded,  and  (6)  the 
resolution  or  sensitivity  achieved. 
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Since  the  research  program  represented  a  study  in  feasibility 
throughout,  the  parameters  selected  for  recording  do  not  necessarily 
represent  an  optimum  set  to  reflect  in-flight  pilot  performance.  Rather, 
the  instrumented  parameters  signify  an  initial  attempt,  based  on 
experience  and  intuitive  judgment,  at  evolving  a  meaningful  set  of 
variables  from  which  performance  measures  could  be  developed  to  assess 
actual  pilot  performance.  To  be  precise,  the  parameters  listed  in 
Table  I  have  previously  undergone  several  iterations  of  analysis  and 
modification.  The  effectiveness  of  these  parameters  with  regard  to  the 
characteristics  of  reliability,  validity,  and  sensitivity  in  recording 
in-flight  pilot  performance  is  contained  in  a  later  discussion  that 
concludes  Section  II. 

b.  Sensor  Systems 

The  selection  of  sensors  for  each  of  the  recorded  parameters  was 
based  on  the  estimated  resolution  requirements  for  conducting  pilot 
performance  measurement  research.  With  the  exception  of  the  altitude, 
g,  pitch  rate,  and  roll  rate  parameters,  those  flight  and  engine  measures 
have  either  equalled  or  exceeded  the  predetermined  resolution  require¬ 
ments.  It  is  necessary  to  point  out  at  this  time  that  some  of  the 
recorded  parameters  were  discarded  by  the  authors  early  in  the  develop¬ 
ment  of  performance  measurement  techniques  as  not  being  applicable  to 
the  maneuvers  being  investigated.  Thus,  the  determination  of  the 
resolution  achieved  from  these  unessential  parameters  was  not  pursued. 

The  sensors  and  recording  equipment  were  strictly  off-the-shelf 
components  that  had  proved  to  be  reliable  in  previous  Flight  Test 
projects.  Table  II  presents  a  description  of  the  dimensions,  weight, 
power  requirements,  and  cost  of  the  equipment  installed  in  948  that 
comprised  the  data  acquisition  system.  The  approximate  physical 
location  of  the  equipment  installed  in  948  is  indicated  in  Figure  2. 


23 


AFHRL-TR-72-6 


Ui 

a i 

< 


m 

J 

H 

W 

a 

H 


O 

w 


cm 

u 

to 

w 

Q 


COST 

$  76,000 

23,000 

1,000 

750 

500 

o 

o 

CM 

200 

390 

390 

900 

100 

o 

o 

00 

800 

100 

$110,130 

re 

rH 

rH 

rH 

cn 

■ 

u.. 

o 

o 

m 

O 

o 

tO 

c 

cn 

o 

rH 

cn 

o 

H 

> 

CM 

m 

s 

cm 

O' 

o 

o 

o 

o 

o 

o 

o 

M 

w 

o 

o 

o 

o 

o 

o 

o 

G> 

cm 

sr 

<r 

<r 

<t 

<y 

U4 

w 

cm 

uj 

to 

H 

in 

m 

in 

m 

m 

m 

m 

o 

O  J 

rH 

rH 

rH 

rH 

fX 

<  O 

rH 

rH 

rH 

rH 

rH 

rH 

rH 

d 

> 

a 

M 

to 

LO 

m 

05 

(Y, 

CO 

CO 

• 

CM 

S 

§ 

W 

ui 

CO 

CJ  kJ 

00 

CD 

CO 

00 

CD 

o  o 
> 

CM 

CM 

CM 

CM 

CM 

H 

W 

m 

m 

m 

«n 

O 

CO 

CM 

vr 

03 

• 

• 

• 

O 

o 

M 

« 

tn 

<r 

rH 

rH 

CO 

cn 

rH 

rH 

CM 

o> 

w 

►J 

CM 

3 

rH 

m 

m 

in 

m 

m 

m 

PS 

• 

• 

• 

* 

• 

• 

o 

o 

o\ 

o> 

M3 

m 

m 

m 

m 

CM 

CM 

M3 

CM 

rH 

rH 

cn 

-  •  - . 

CO 

55 

O 

M 

CM 

m 

m 

m 

m 

CO 

3 

• 

o 

O 

• 

• 

cn 

• 

• 

MD 

in 

M3 

00 

m 

1 

ON 

*H 

rH 

m 

m 

CM 

CM 

Q 

M3 

m 

m 

m 

in 

• 

o 

O 

M0 

M3 

• 

• 

• 

• 

rH 

m 

CM 

CD 

o 

hJ 

CM 

CM 

rH 

Hf 

cn 

cn 

rH 

XI 

rH 

•H 

0 

M 

/-s 

G 

Xi 

O 

3 

CM 

t> 

4J 

u 

x> 

v-' 

M 

G 

XI 

U 

0 

OC 

O 

G 

3 

Xi 

Xi 

Xi 

■u 

G 

O 

0 

> 

3 

3 

3 

•H 

O 

G 

Xi 

O 

a 

XI 

«H 

c 

G 

H 

3 

3 

3 

M 

3 

o 

0 

ai 

XI 

*3 

•3 

3 

*o 

•H 

•3 

xi 

1 

Xi 

cn 

CO 

> 

XI 

o 

U 

4J 

U 

9 

3 

G 

C 

O 

Xi 

G 

•H 

Xi 

CO 

u: 

S 

at 

•H 

O 

0 

>•. 

> 

3 

3 

Xi 

3 

O 

G 

3 

hJ 

cm 

■3 

*3 

O 

ai 

rH 

G 

Xi 

X* 

>> 

XI 

O 

13 

XI 

P 

3 

u 

G 

3 

cm 

(X 

O 

H 

H 

o 

3 

ex 

H 

F- 

T3 

o 

o 

PS 

a 

U 

B 

O 

ctf 

O 

< 

O 

u 

u 

u 

3 

3 

TJ 

O 

O 

Xi 

ns 

Eh 

r-s 

CJ 

3 

rH 

3 

CO 

o 

3> 

3 

3 

Xi 

G 

J* 

< 

CJ 

cm 

rH 

3 

T3 

x» 

3 

3 

u 

3 

3 

o 

ft 

3 

3 

XI 

X» 

Xt 

*G 

x> 

a 

*H 

rH 

3 

3 

u 

« 

3 

G 

•H 

O 

3 

u 

•H 

ro 

XI 

3 

a* 

3 

CO 

s 

rH 

a 

GO 

00 

U 

£ 

c 

XI 

Xi 

Xi 

O 

3 

XI 

3 

c 

3 

•H 

•H 

3 

o 

£> 

•H 

3 

O 

Xi 

3 

xi 

is 

Pu 

H 

CO 

Q 

US 

(X 

CO 

< 

< 

> 

< 

Ui 

os 

Pi 

24 


The  following  is  a  cursory  description  of  the  recorded  parameters 
including  the  components  employed  in  the  sensor  systems  and  the  displays 
provided  to  the  pilot  in  the  cockpit: 

(1)  heading 

The  T-37B  aircraft  normally  contains  a  J-2  slaved  directional 
gyro  system.  However,  due  to  excessive  precession  errors  and  a  basic 
lack  of  responsiveness  encountered  during  calibration  flight  tests  when 
performing  high  pitch  and  bank  angle  maneuvers  (e.g.,  lazy  8  and  barrel 
roll),  a  J-4  compass  system  was  substituted  in  948.  The  J-4  system 
added  the  capability  for  (1)  latitude  correction,  (2)  a  synchronizer 
switch  to  provide  a  normal  means  of  orienting  the  gyro  to  the  signals 
from  the  remote  compass  transmitter,  ana,-  most  importantly,  (3)  a  15- 
second  fast  slave  cycle  that  could  be  induced  whenever  the  function 
selector  switch  was  moved  from  the  MAG  (magnetic)  to  the  DG  (directional 
gyro)  position  and  returned  to  MAG  by  the  instructor  pilot.  A  synchro- 
follower  provided  the  signal  output  from  the  compass  to  the  Pulse  Code 
Modulation/Data  Acquisition  System  (PCM/DAS).  The  heading  system  was 
excited  by  +5  volts  DC  over  a  range  of  0-360°  with  approximately  0.0128 
volts  representing  1°.  The  effective  resolution  achieved  was  +1°  from 
the  cockpit  instrument,  which  consisted  of  a  standard  T-37  heading 
indicator  with  a  fixed  card  and  rotating  needle.  A  heading  set  knob 
permitted  the  compass  card  to  be  rotated  by  the  pilot. 

(2)  Altitude 

A  Model  7000  altitude  transducer  manufactured  by  Computer 
Instruments  Corporation  provided  a  signal  output  to  the  PCM/DAS  for 
aircraft  pressure  altitude.  The  altitude  transducer  was  linked  directly 
with  the  normal  aircraft  pitot-static  system.  With  a  voltage  output  of 
+5  DC  over  a  range  of  0-30,000  ft,  each  100  ft  was  represented  by 
approximately  0.0150  volts.  The  effective  resolution  achieved  with  the 
parameter  of  altitude  varied  between  139  and  189  ft  error  on  the  data 
collection  flights  with  a  mean  resolution  of  ±166  ft.  A  standard 
three-pointer  altimeter  was  located  on  the  left  side  of  the  cockpit 
with  which  the  transducer  was  correlated. 
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(3)  Airspeed 

The  airspeed  signal  to  the  PCM/DAS  was  transmitted  by  a 
Model  7100  Computer  Instruments  Corporation  airspeed  transducer. 

Connected  to  the  pitot-static  system  of  the  aircraft,  the  +5  volt  DC 
transducer  output  covered  0  to  350  knots  IAS  with  approximately  0.0118 
volts  representing  1  knot.  The  resolution  achieved  was  a  fairly  constant 
error  of  +2  knots  from  the  standard  airspeed  indicator  on  the  left  side 
of  the  cockpit. 

(4)  Pitch  and  Roll  Ancles 

The  T-37  has  an  attitude-indicating  system  consisting  of  a 
MD-1  vertical  gyre  and  a  MM-3  attitude  indicator  located  on  the  left 
instrument  panel.  Due  to  the  possibility  of  affecting  the  safe 
operation  of  this  system  by  attaching  a  synchro-follower,  a  second  MD-1 
gyro  was  installed  in  948  that  provided  a  +5  volts  DC  output  from  the 
synchro-follower  directly  to  the  PCM/DAS.  Within  the  pitch  limitation 
of  the  gyro  of ±82°,  an  effective  resolution  of  +1.5°  of  the  pitch  angle 
as  indicated  on  the  MM-3  attitude  indicator  was  achieved.  Approximately 
0.0144  volts  represented  1°  of  pitch  attitude.  The  roll  angle  parameter 
had  a  full  360°  capability  from  the  gyro  and  a  resolution  error  of  +1.5° 
from  the  indicated  bank  angle.  A  voltage  output  of  0.0143  represented 
1°  roll  angle. 

(5)  Acceleration  (g  Force) 

Acceleration  along  the  Z  axis  of  the  aircraft  was  sensed  by  a 
separate  accelerometer  that  was  installed  in  948  and  correlated  in-flight 
with  the  standard  g  meter  located  in  the  center  of  the  instrument  panel. 
With  a  +5  volts  DC  output  from  the  accelerometer  to  the  PCM/DAS, 
approximately  0.140  volts  represented  O.lg.  An  effective  resolution  of 
+0.3g  was  obtained  with  the  parameter  system. 
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(6)  Pitch,  Roll,  and  Yaw  Rates 

A  single  unit  containing  rate  gyros  for  the  pitch,  roll,  and 
yaw  axes  was  installed  and  powered  by  115  volt,  400  cycle,  single  phase 
AC.  The  outputs  from  the  gyros  were  transmitted  through  a  Signal 
Conditioning  Unit  to  the  PCM/DAS.  Pitch  rate  was  represented  by 
approximately  0.0553  volts  DC  for  1°  per  second  over  a  range  of  0-90° 
per  second.  Roll  rate  was  represented  by  approximately  0.0259  volts 
DC  for  1°  per  second  over  a  range  of  0-180°  per  second.  Yaw  rate  was 
represented  by  approximately  0.0680  volts  DC  for  1°  per  second  over  a 
range  of  0-70°  per  second.  The  resolution  achieved  on  these  three 
parameters  was  not  empirically  ascertained  because  of  the  lack  of  a 
cockpit  indication  with  which  to  compare  the  accuracy  of  the  rate  gyros 
in-flight. 

(7)  Longitudinal  and  Lateral  Stick  Position,  Rudder  Position 

The  pilot's  movement  of  the  aircraft  control  stick  and  rudder 
pedals  was  recorded  by  linking  "pots"  (potentiometers)  to  the  elevator 
cable,  left  aileron  cable,  and  rudder  cable  that  produced  a  +5  volt  DC 
signal  to  the  PCM/DAS.  The  longitudinal  stick  position  had  a  range  of 
-15°  for  forward  stick  (elevator  down)  to  +25°  for  aft  stick  (elevator 
up)  with  approximately  0.1238  volts  representing  1°  of  elevator  travel. 
The  lateral  stick  position  had  a  range  of  +16°  in  which  0.1526  volts 
represented  1°  of  aileron  travel.  Rudder  pedal  input  had  a  range  of 
+24°  so  that  0.1027  volts  represented  1°  of  rudder  travel. 

(8)  Engine  RPM 

The  RPM  of  the  left  and  right  engines  was  recorded  by 
linking  frequency  converters  to  the  tach  generators.  Approximately 
0.0500  volts  represented  1%  RPM  for  the  left  engine  and  0.0400  volts  for 
the  right  engine  over  a  range  of  0-100%.  A  somewhat  constant  resolution 
error  of  -1  %  RPM  was  achieved  when  compared  with  the  two  tachometers  on 
the  center  instrument  panel  in  the  cockpit. 


28 


. -------- 


AFHRL-TR-72-6 


(9)  Thrott'  Position 

The  left  and  right  throttle  positions  were  recorded  by  a 
+5  volt  DC  output  from  pots  linked  to  the  throttle.  With  a  range  of 
0-64°  from  the  CUTOFF  position  to  100%  engine  RPM,  approximately  0.0689 
volts  represented  1°  movement  for  the  left  throttle  and  0.0659  for  the 
right  throttle. 

{10)  Flaps 

The  position  of  the  wing  flaps  was  recorded  by  a  pot  output 
of  +5  volts  DC  that  was  linked  to  the  flap  indicator  signal  to  the  cockpit 
instrument.  With  a  range  of  0-100%  (0-40°),  1%  of  flap  movement  was 
represented  by  approximately  0.0475  volts  within  1%  resolution. 

(11)  Landing  Gear,  Speed  Brakes,  Thrust  Attenuator, 

Elevator  Trim  Tab  Up  and  Down 

The  operations  of  these  systems  were  recorded  as  discrete 
events  by  linking  the  switch  signal  directly  to  the  PCM/DAS. 

A  complete  listing  of  the  calibration  data  for  the  recorded  flight 
and  engine  parameters  may  be  found  in  Appendix  I. 

c.  Recording  System 

The  actual  recording  of  the  parameter  data  transmitted  by  the 
various  sensor  systems  was  accomplished  by  two  components,  an  analog-to- 
digital  converter  and  a  digital  tape  recorder. 

(1)  Analog-to-Digital  Converter 

A  Pulse  Code  Modulation/Data  Acquisition  System  (Model  101) 
manufactured  by  Brown  Engineering  Co.  (Reference  2)  converted  the  analog 
signals  from  the  sensors  to  a  digital  format  and  transmitted  the  output 
to  the  magnetic  tape  recorder.  The  PCM/DAS  possesses  the  functional 
capability  of  (1)  accepting  up  to  30  analog  signals  varying  between 
+5  volts,  (2)  sampling  6  of  these  analog  signals  at  100  times  per  second 
and  the  remaining  24  at  10  times  per  second,  (3)  converting  these  analog 
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signals  to  a  10-bit  digital  representation  plus  a  sign  bit,  (4)  providing 
an  output  format  containing  98  data  words  and  2  sync  words  per  master 
frame  (major  cycle),  and  (5)  generating  a  binary  coded  decimal  (BCD) 
representation  of  the  elapsed  time  in  hours,  minutes,  and  seconds  from  a 
stable  time  reference. 

(2)  Digital  Tape  Recorder 

A  16-channel  Leach  tape  recorder  (Model  MTR-3200)  recorded 
the  PCM/DAS  digital  signals  on  a  1-inch  magnetic  tape.  Powered  by  +28 
volts  DC,  the  tape  recorder  was  operated  at  a  speed  of  7-1/2  inches  per 
second.  The  tape  capacity  of  3/4  mil  and  2,400  feet  loaded  on  an  8-inch 
reel  provided  60  minutes  of  recording  time.  The  recorder  unit  was 
located  in  a  lower  fuselage  bay  area  with  a  remote  control  unit  in  the 
cockpit. 

(3)  Cockpit  Recorder  Control  Panel 

The  acquisition  of  in-flight  pilot  performance  data  was 
controlled  by  the  instructor  pilot  (in  the  right  seat)  through  the 
operation  of  the  magnetic  tape  recorder  with  the  Recorder  Control  Panel. 
This  control  unit  shown  in  Figure  3  was  located  between  the  ejection 
seats  in  an  area  formerly  occupied  by  a  map  and  data  case.  A  description 
of  the  Recorder  Control  Panel  switch  functions  (left  to  right  and  top  to 
bottom)  follows: 

(1)  MASTER  SW  (ON-OFF)  -  controls  power  to  the  entire  data 
recording  system. 

(2)  INVERTER 

(a)  red  FAIL  light  -  illuminates  to  signal  inverter 

failure. 

(b)  ON-OFF  switch  -  115-volt,  400-cycle,  single-phase 
AC  power  supply  which  provided  5  volts  DC  excitation  for  all  the  pots. 

(3)  COUNTER  -  three-digit  counter  that  continuously  codes 
record  number  on  the  tape. 
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(4)  GROUND-TO-FLIGHT  guarded  switch. 

(a)  OFF  (guard  up)  -  permits  local  manual  operation  of 
recorder  on  the  ground  for  purposes  of  checkout,  tape  loading,  and 
maintenance. 


(b)  ON  (guard  down)  -  recorder  in  remote  mode  controlled 
only  by  adjacent  RECORDER  POWER  and  CONTROL  switches. 

(c)  green  light  -  illuminates  when  recorder  is  set  for 
remote  cockpit  operation. 

(5)  TAPE  RECORDER  controls 

(a)  left  amber  light  -  illuminates  when  recorder  is  ready 
for  data  recording  and  extinguishes  during  tape  operation. 

(b)  right  amber  light  -  illuminates  when  recorder  is 

operating. 

(c)  POWER  switch  (ON-OFF)  -  provides  28-volt  DC  power  to 

tape  recorder. 

(d)  CONTROL  switch  (ON-OFF)  -  operates  tape  recorder  for 
data  acquisition  purposes. 

(6)  PCM/DAS  (ON-OFF)  -  provides  28-volt  DC  power  to  the  Pulse 
Code  Modulation/Data  Acquisition  System. 

(7)  TIME  CODE  switch 

(a)  START  -  inputs  a  continuous  time  signal  to  the  tape. 

(b)  OFF  position  resets  the  clock  to  zero. 

(8)  PILOT  EVENT  button  -  permits  momentary  coding  on  tape  of 
a  significant  event  when  depressed. 


32 


AFHRI  - TR- 72-6 


(9)  AUTO.  CAL.  button  -  initiates  an  automatic  300-millisecond 
internal  calibration  program  sequentially  on  each  scoring  parameter. 

(10)  PCM/DAS  POWER  fuse  -  a  1-1/2  amp  fuse  protecting  the  system. 

(11)  RECORD  NO.  -  advances  counter  one  number  when  depressed. 

Just  aft  of  the  Recorder  Control  Panel  is  located  the  J-4  Compass 
System  Control  Panel  which  contains  the  following  switch  functions: 

(1)  DEC/SET/INC  Synchronizer  Switch  -  permits  manual  slaving  of 
the  gyro  to  the  signal  from  the  remote  compass  transmitter  by  using  the 
MAG  annunciator  window  as  a  slaving  reference. 

(2)  DG/MAG  Function  Selector  Switch 

(a)  operates  in  a  non-slaved  mode  by  selecting  the  DG  position. 

(b)  operates  as  a  slaved  heading  system  in  the  MAG  position 
by  using  the  signals  from  the  remote  compass  transmitter  located  in  the 
left  wing  tip. 

(c)  a  15-second  fast  slaving  cycle  is  induced  when  the 
function  selector  switch  is  moved  from  the  MAG  to  DG  position  and 
returned  to  MAG. 

(3)  Latitude  Correction  Knob  (LAT)  -  reduces  the  apparent 
precession  caused  by  the  higher  latitudes  when  operating  in  a  non-slaved 
mode. 

A  J-4  POWER  switch  was  installed  adjacent  to  the  J-4  Control  Panel  to 
provide  system  power. 
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(4)  Audio  Tape  Recorder 

A  Norelco  portable  audio  tape  recorder  (Model  150)  was  utilized 
to  record  all  interphone  and  UHF  radio  communications  in  the  aircraft. 

The  transistorized  recorder  operated  on  five  1.5  volt  (C  cell)  batteries 
at  a  tape  speed  of  1-7/8  inches  per  second  that  provided  30  minutes' 
recording  time  on  each  side  of  the  C -60  cartridge.  A  holder  was  installed 
on  the  right  sidewall  of  948  (see  Figure  1)  in  which  the  recorder  was 
placed  during  the  flight.  A  "Y"  cord  was  locally  fabricated  that  would 
interface  between  the  normal  aircraft  interphone  jack  and  the  tape 
recorder. 

(5)  System  Effectiveness 

The  effectiveness  of  the  data  acquisition  system  must 
ultimately  be  evaluated  in  terms  of  the  capability  it  provided  in  the 
development  of  measurement  methods  and  the  quantitative  assessment  of 
in-flight  pilot  performance.  This  system  effectiveness  is  directly 
related  to  the  three  fundamental  requirements  of  an  objective  pilot 
performance  measurement  system  -  reliability,  validity,  and  sensitivity. 

The  data  acquisition  system  overall  provided  a  degree  of  reliability 
that  was  considerably  better  than  was  originally  expected.  Many  of  the 
problems  encountered  early  in  the  program  during  the  calibration  flights 
were  corrected  by  modifications  and  improvements  to  the  sensor  systems 
and  power  supply.  The  subsequent  data  collection  flights  conducted  at 
Williams  AFB ,  Arizona,  with  students  and  instructors  were  virtually 
unhampered  by  equipment  failure  in  the  instrumentation  package.  The 
Leach  magnetic  tape  recorder  did  cause  some  difficulty  occasionally  that 
was  usually  corrected  by  cleaning  the  tape  head.  At  one  point  in  the 
student  data  collection  phase,  the  tape  recorder  had  to  be  returned  to 
the  manufacturer's  facility  for  overhaul. 

A  rather  serious  problem  was  experienced  throughout  the  entire 
Pilot  Performance  Measurement  Program  with  the  heading  parameter.  As 
stated  earlier,  a  J-4  compass  system  was  substituted  for  the  normal  J-2 
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system  in  the  T-37  due  to  excessive  precession  errors  with  the  original 
system.  This  change  was  quite  valuable  since  the  J-4  system  proved  to 
be  more  stable  and  any  precession  encountered  during  the  flight  could  be 
quickly  eliminated  by  manually  inducing  the  fast  slave  cycle  between 
recorded  maneuvers.  However,  inherent  limitations  of  the  heading  sensor 
system  with  the  synchro-follower  permitted  the  accurate  recording  of 
heading  (+1°)  only  in  the  southeast,  southwest,  and  northwest  quadrants, 
or  specifically  between  090  and  360°.  Anytime  the  aircraft  turned  to 
the  northeast  (360-090°),  the  recorded  data  was  erroneous.  This  heading 
restriction  could  be  compensated  for  somewhat  by  performing  the  maneuvers 
on  southern  and  westerly  headings.  Unfortunately  this  was  not  always 
possible  due  to  the  constraints  imposed  upon  the  aircraft  operations  by 
the  ATC  airspace  requirements.  Although  the  parameter  of  aircraft 
heading  was  the  primary  reference  variable  in  the  lazy  8  maneuver,  the 
lack  of  full  360°  recording  capability  inhibited  the  development  of 
performance  measures  and  forced  the  authors  to  eliminate  it  as  a  measure¬ 
ment  variable. 

The  sensitivity  achieved  from  altitude  was  somewhat  less  than  the 
predetermined  requirement  of  50  ft,  but  the  actual  altitude  error  of 
+166  ft  was  still  sufficiently  accurate  to  permit  meaningful  measurement 
research  on  the  lazy  8  and  barrel  1  roll  maneuvers.  However,  for  other 
types  of  maneuvers,  such  as  the  360°  overhead  traffic  pattern,  the 
altitude  error  would  have  to  be  reduced  considerably  before  appropriate 
performance  measures  could  be  developed.  The  altitude  error  encountered 
appeared  to  vary  to  some  extent  from  one  day  to  the  next,  perhaps  as  a 
function  of  temperature  or  humidity.  Generally  the  altitude  recorded 
from  the  surface  of  5500  ft  was  less  than  the  actual  mean  sea  level 
altitude  of  the  aircraft.  At  approximately  5500  ft,  a  crossover 
occurred  such  that  the  recorded  aUi+ude  became  greater  than  the  actual 
altitude  of  the  aircraft  (positive  .iior),  and  the  error  increased 
slowly  but  progressively  as  a  function  of  increasing  altitude.  The 
altitudes  between  2500  and  8500  ft  resulted  in  the  most  accurate  data  on 
aircraft  altitude. 
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Initially,  it  appeared  the  gyro  limitation  of  +82°  would  pose  a 
problem  for  the  accurate  recording  of  pitch  angle;  but,  subsequent  student 
data  collection  flights  revealed  the  maximum  pitch  angle  for  the  two 
primary  maneuvers  of  interest  did  not  exceed  70°.  Thus,  the  attitude 
gyro  was  quite  satisfactory  regarding  the  range  of  values  sensed  as  well 
as  the  +1.5°  resolution  from  the  indicated  pitch  and  roll  angle.  In  the 
over-the-top  maneuver  such  as  loop,  clover-leaf,  Immelmann,  etc.,  the 
vertical  limitation  of  82°  affected  the  capability  to  accurately 
reconstruct  the  actual  maneuver.  Of  course,  the  360°  roll  capability 
of  the  MD-1  gyro  and  a  resolution  of  +1.5°  bank  angle  provided  accurate 
performance  data  on  that  parameter  irrespective  of  the  maneuver  performed. 
It  was  possible  to  experience  some  degradation  in  the  accuracy  of  pitch 
and  roll  data  whenever  insufficient  time  was  allocated  between  maneuvers 
with  large  pitch  and  roll  excursions.  An  attitude  fast  erection  system 
switch  on  the  instrument  panel  could  be  activated  within  certain 
operational  limitations  by- the  pilot  whenever  the  attitude  indicator 
was  precessed  excessively. 

The  parameters  of  acceleration  (g  force),  pitch  rate,  roll  rate,  and 
yaw  rate  were  quite  adversely  affected  by  turbulance  and  gust  loads. 

Large  spikes  in  the  data  indicated  the  sensor  systems  of  these  four 
parameters  were  too  sensitive  for  accurate  recording  of  in-flight  data. 

With  respect  to  the  validity  of  the  in-flight  pilot  performance  data, 
the  basic  philosophy  adopted  was  that  the  recorded  values  should 
correlate  as  closely  as  possible  with  the  values  displayed  on  the 
respective  cockpit  flight  or  engine  instrument  from  which  the  pilot 
derived  his  information.  Thus,  there  was  less  concern  regarding  a 
minimal  error  existing  between  the  actual  parameter  value  and  instrument 
reading  than  any  error  encountered  between  the  instrument  reading  and 
recorded  value.  However,  the  cockpit  instruments  of  the  more 
significant  parameters  (e.g.,  heading,  altitude,  and  airspeed)  were 
calibrated  by  bench  checks,  tower  fly-bys,  and  pacer  aircraft  flights 
to  ascertain  their  real-world  accuracy  and  the  extent  of  inherent  errors 
existing  that  affect  the  instrument  indications  such  as  mechanical  error. 
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scale  error,  installation/position  error,  reversal  error,  and  hysteresis 
error. 
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SECTION  III 

GROUND-BASED  DATA  CALIBRATION  SYSTEM 


1.  OVERVIEW 

Considerable  data  processing  and  logistics  effort  was  required  to 
convert  the  recorded  flight  data  into  a  form  suitable  for  research  and 
analysis.  The  physical  characteristics  of  the  flight  recorder  tape  made 
it  incompatible  with  the  data  processing  equipment  available  for  extensive 
data  analysis.  This  necessitated  an  initial  conversion  of  the  data  to 
IBM-compatible  tape.  The  operating  system  characteristics  of  the  data 
processing  installation  supporting  the  study  made  necessary  a  reformatting 
of  data  prior  to  calibration.  Also,  the  quantity  of  data  involved 
necessitated  the  development  and  rigid  adherence  to  an  extensive  data- 
cataloging  system. 

While  these  requirements  are  not  necessarily  unique  to  this  particular 
study,  they  were  complicated  by  the  fact  that  different  sources  had  to  be 
used  for  various  portions  of  the  data  processing  effort.  The  initial 
conversion  of  the  data  to  IBM-compatible  tape  was  accomplished  by  the 
ASD  Flight  Test  Data  Reduction  Branch,  whereas  all  subsequent  data 
processing  work  was  done  by  the  ASD  Computing  and  Information  Systems 
Branch  using  different  equipment.  Among  other  things,  this  amplified 
problems  inherent  in  reading  and  writing  magnetic  tape.  In  addition, 
data  analysis  requirements,  as  anticipated,  varied  as  the  research 
progressed,  and  several  different  programmers  were  subsequently  involved. 
This  resulted  in  more  data-passes  than  desired  and,  to  enhance  reliability 
and  simplify  data  handling,  necessitated  the  transfer  of  individual  flight 
maneuvers  data  to  cards.  Figure  4  illustrates  the  general  flow  of  data 
and  the  order  in  which  various  processing  and  research  tasks  were 
accomplished. 
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2.  TAPE  FORMAT  CONVERSION 

a.  Recorder  Tape 

The  flight  data,  as  it  appears  on  the  recorder  tape,  consists  of 
successive  frames  of  100  words  each.  The  1st  and  100th  words  of  each 
frame  are  sync  words,  the  2nd  through  97th  words  are  data  words,  and  the 
98th  and  99th  are  time  words. 

The  tape  is  1  inch  wide  and  has  16  tracks  (14  recorded).  Figure  5 
illustrates  the  information  format  and  the  order  of  the  recorded 
variables  stored  repeatedly  in  each  100-word  frame.  Each  frame 
represents  0.1  seconds  of  data.  Since  the  recording  speed  of  the  tape 
is  7.5  inches  per  second,  the  data  density  on  the  tape  is  133  bits  per 
inch  (BPI)  per  track. 

The  recorder  tape  is  read  on  an  Ampex  FR-1200  recorder-reproducer, 
processed  through  a  DDP-24  system,  and  written  on  1/2  inch  processor 
tape. 

b.  Processor  Tape 

As  it  appears  on  the  processor-tape,  the  flight  data  are 
formatted  in  1230-word  records,  each  word  of  which  has  a  parity  bit 
(bit  1),  sign  bit  (bit  2),  and  ten  magnitude  bits  (bits  3-12).  There 
are  12  frames  of  100  words  apiece,  each  preceded  by  2  frame-delineation 
words  (77770,  7777J.  The  first  two  words  of  each  record  are  the  record 

O  O 

number,  and  the  last  four  words  contain  all  zeros.  The  record  length 
of  1230  12-bit  words  makes  it  possible  to  convert  each  record  into  410 
36-bit  words  for  compatibility  with  the  IBM  7094.  The  processor  tape 
density  is  556  bits  per  inch  (BPI). 

c.  Blocked  Tape 

All  operations  on  the  data  subsequent  to  the  conversion  from 
recorder  to  processor  tape  were  accomplished  using  a  7094/7044  Direct 
Coupled  Computing  System  (DCS).  In  the  DCS,  the  IBM  7044  computer 
processes  all  input/output,  and  the  system  requires  that  magnetic  tape 
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100  WORDS  -  1  FRAME 


WORD 

VARIABLE 

WORD 

VARIABLE 

1 

Sync 

42-47 

100/Sec  Words 

2-7 

100/Sec  Words: 

48 

Flap  Position 

Pitch,  Roll,  long. 

49 

Speed  Brake 

Stick  Position,  Lat. 

50 

Landing  Gear 

Stick  Position, 

51 

LH  Throttle 

Rudder  Position, 

Position 

Airspeed 

52-57 

100/Sec  Words 

8 

Thrust  Attenuator 

58 

RH  Throttle 

Position 

9-11 

None 

59 

LH  RPM 

12-17 

100/Sec  Words 

60 

RH  RPM 

18 

Roll  Rate 

61 

Pitch  Rate 

19-21 

None 

62-67 

100  Sec  Words 

22-27 

100/Sec  Words 

68 

Event  Number 

28 

None 

69-71 

None 

29 

Trim  Tab  Up 

72-77 

100  Sec  Words 

30 

Trim  Tab  Down 

78-81 

None 

31 

None 

82-87 

100/Sec  Words 

32-37 

100/Sec  Words 

88-91 

None 

38 

Altitude 

92-97 

100/Sec  Words 

39 

Heading 

98-99 

Time  (BCD) 

40 

Yaw  Rate 

100 

Sync 

41 

Acceleration  (g  Force) 

1 

o 

2 

□ 

3 

□ 

4 

□ 

5 

□ 

1 

□ 

7 

□ 

□ 

9 

□ 

10 

□ 

11 

□ 

i? 

□ 

13 

a 

'4 

□ 

15 

a 

16 

□ 

LSB 


>  MAGNITUDE  OF  UATA-WORD 


MSB 
SIGN 

PARITY  (EVEN) 

CLOCK  PULSE  (EVERY  WORD) 

FRAME  PULSE  (EVERY  0.1  SEC  OR  100  WORDS) 

UNUSED 


Figure  5.  Flight  Recorder  Tape 
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input  be  blocked  into  successive  460-word  records.  Therefore,  a 
blocked  tape  had  to  be  prepared  from  each  processor  tape  prior  to 
beginning  calibration  and  other  computations. 

To  generate  the  blocked  tape,  the  12-bit  words  on  the  processor  tape 
were  picked  up  three  at  a  time  to  form  36-bit  7094-compatible  words. 

These  words  were  written  onto  the  blocked  tape  in  binary  records  of  460 
36-bit  words  at  a  density  of  800  BPI. 

3.  CALIBRATION 

a.  Calibration  Data  and  Procedures 

Calibration  of  the  flight  data  required  a  conversion  of  each 
recorded  digital  number  to  volts,  then  a  conversion  from  volts  to 
parameter  values.  For  the  conversion  to  volts,  the  following  formula 

was  applied: 

Volts  =  0.0051281  (recorded  number)  -  0  1256 

This  formula  was  derived  from  data  published  in  a  Brown 
Engineering  manual  (Reference  2). 

For  conversion  from  volts  to  parameter  values,  calibration  data 
derived  by  instrumentation  personnel  were  used.  An  attempt  was  made  to 
curve-fit  the  calibration  data  using  (1)  a  single  linear  fit  for  each 
set  of  calibration  data  as  well  as  (2ja  quadratic  fit.  The  fits  were 
evaluated  by  a  comparison  with  data  obtained  through  linear  interpolation. 
Considering  the  magnitude  of  the  errors  obtained  with  either  type  of 
curve  fit  (see  Table  III)  and  considering  the  likely  (and  eventually  all 
too  true)  requirement  of  frequent  alterations  to  the  calibration  data, 
it  was  decided  that  linear  interpolation  must  be  used. 
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TABLE  III 

ERRORS  OBSERVED  IN  TRIAL  ATTEMPT  TO  CURVE-FIT 
CALIBRATION  DATA 


Maximum  Error 

Units 

Word 

Quadratic  fit 

Linear  fit 

Pitch 

1.47 

1.69 

Deg 

Roll 

.61 

.58 

Deg 

Stick 

Pos.  (Long.) 

.48 

1.54 

Deg 

Stick 

Pos.  (Lat.) 

.82 

.87 

Deg 

Rudder  Pos. 

1.25 

1.61 

Deg 

Airspeed 

6.47 

11.02 

Knots 

Roll  Rate 

2.04 

23.80 

Deg/Sec 

Altitude 

31.48 

1972.07 

Ft 

Yaw  Rate 

15.45 

15.45 

Deg/Sec 

Acceleration 

.62 

.64 

g's 

Flap  Pos. 

2.58 

4.95 

Percent 

Throttle  (LH) 

1.12 

.99 

Deg 

Throttle  (RH) 

1.93 

2.27 

Deg 

RPM  (LH) 

.14 

.34 

Percent 

RPM  (RH) 

.53 

.52 

Percent 

Pitch  Rate 

6.73 

6.89 

Deg/Sec 
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Appendix  I  shows  the  calibration  data  and  calibration  block  diagram 
for  all  recorded  variables  except  (1)  discrete  variables,  (2)  event 
number,  and  (3)  time.  The  calibration  data  were  stored  on  cards  to 
simplify  updating  and  were  read  into  the  7094  and  interpolated  linearly 
to  effect  the  calibration.  Discrete  variables  were  converted  to  1  if 
volts  were  greater  than  or  equal  to  2.5,  and  to  0  otherwise.  No 
calibration  was  required  for  the  event  number.  Time  is  recorded  on  the 
flight  tape  as  a  type  of  BCD  quantity  and  required  special  treatment  for 
conversion  to  hours,  minutes,  and  seconds.  As  recorded,  time  consumes 
two  12-bit  words,  with  individual  bits  therein  weighted  BCD  as  follows: 

123456789  10  II  12 

xi  i  1 1 1 1 1 1 1  n~ 

20  10  8  4  2  I  40  20  10  8  4 

' - * - - - '  - - * - ' 

hours  minutes 


TIME  WORD  1  : 


BIT  : 


weight: 


TIME  WORD  2  I 


BIT:  12  5  4  5  6  7  8  9  10  II  12 

MX]  I  I  I  I  I  I  I  □%! 


weight: 


I  .  .40  20  10  8  4  2  \j 

-* >  V  . . 


MIN. 


SECONDS 


During  the  calibration  run,  time  was  converted  to  seconds  by 
appropriately  adding  products  of  weights  and  bits  as  indicated  above, 
multiplying  the  result  by  60,  in  the  case  of  minutes,  and  3600,  in  the 
case  of  hours,  and  summing. 

b.  Computed  Variables 

Some  additional  variables  were  computed  from  the  recorded  flight 
data  at  the  time  of  data  calibration.  The  computed  variables  are 
summarized  in  Table  IV.  The  first  five  variables  in  the  table  were 
computed  because  they  were  believed  to  be  potentially  useful  in  measure¬ 
ment.  Pitch,  roll,  and  yaw  angles  were  computed  solely  as  a  check  on 
the  recorded  pitch  and  roll  values  and  the  recorded  body-axis  rates. 

Time  was  computed  as  a  check  on  the  recorded  time  and  the  sampling 
frequency. 
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TABLE  IV 

COMPUTED  FLIGHT  VARIABLES 


Variab le 

1.  Vertical  Velocity 

2.  Longitudinal  Stick  Rate 

3 .  Turn  Rate 

4.  Lateral  Stick  Rate 

5 .  Rudder  Rate 

6 .  Pitch 

7.  Roll 

8.  Yaw 
° .  Time 


Computed 

From 

Altitude 

Longitudinal  Stick 
Position 

Heading 

Lateral  Stick 
Position 

Rudder  Position 

Pitch  Rate 

Roll  Rate 

Yaw  Rate 

Recording 

Frequency 
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Unfortunately,  little  use  could  be  made  of  any  of  the  computed 
variables  with  the  exception  of  time.  The  primary  reason  was  because 
spurious  "glitches"  in  the  data  destroyed  computational  continuity.  In 
addition,  numerical  differentiation  amplified  all  noise  and  thereby 
rendered  the  variables  computed  useless.  Some  experiments  with  other 
methods  of  computation  were  attempted.  However,  the  importance  and 
urgency  of  other  problems  to  be  contended  with  and  the  main  research  to 
be  conducted  quickly  forced  abandonment  of  the  computation  of  additional 
variables  during  calibration.  It  was  decided  that  such  computations, 
if  required,  should  be  attempted  only  after  smoothing  of  the  data. 


c.  Calibrated  Tape  Format 

As  recorded  on  the  calibrated  tape,  each  data  word  is  an 
IBM  7094  36-bit  floating  point  binary  word,  with  a  sign  bit  (bit  zero), 
8-bit  exponent  field  (bits  1-8),  and  27-bit  mantissa  (bits  9-35). 

The  data  are  recorded  on  1/2  inch,  7-channel  magnetic  tape  at  a  density 
of  800  BPI.  Record  length  is  460  words,  with  words  1,  2,  and  460  used 
as  control  words  meaningful  only  in  connection  with  the  7094/7044  DCS. 

The  data  are  placed  on  the  tape  in  successive  groups,  each  group 
representing  all  data  for  1.2  seconds  of  real  time.  The  order  of  the 
data  as  it  appears  on  the  tape  Is  illustrated  in  Table  V.  All  data 
recorded  at  a  sampling  rate  of  100  per  second  appear  first,  e.g.,  the 
first  1.2  seconds  of  pitch  data,  or  120  samples  of  pitch,  appear  first, 
followed  by  each  of  the  remaining  100  per  second  sampled  variables. 

Data  recorded  at  10  per  second  follows.  The  tape  format  Is  illustrated 
in  Figure  6. 


d.  Tape  Capacity 

Each  binary  data  word  consumes  36  bits  or  6  frames  on  the  tape. 
At  a  recording  density  of  800  BPI,  this  is  equivalent  to  6/800  inches 
of  tape  per  word.  There  are  9  words  recorded  at  100  per  second  and 
25  words  at  10  per  second,  for  a  total  of  1150  words  per  second,  or 
1380  words  in  1.2  seconds.  At  460  words  per  record,  there  are  about 
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3  records  per  1.2  seconds  of  data.  Therefore,  for  each  1.2  seconds 
(3  records)  of  data,  we  require 

6 

- (1380)  +  3(1 RG )  =  10.35  +  2.25  =  12.6  inches  of  tape, 

800 

where  I RG  =  3/4  inches  =  length  of  inter-record  gap.  With  2350  feet  of 
tape  (standard  reel,  allowing  for  leader  and  trailer),  it  is  possible  to 
s  core 

12(2350) 

- (1.2)  =  2686  seconds 

12.6 

worth  of  data,  or  about  45  minutes.  Normally,  this  resulted  in  two 
calibrated  tapes  per  flight. 

e.  Print-Out  Format 

During  the  calibration  run,  an  initial  Drint-out  of  the  data  at 
one  sample  per  second  is  produced.  This  print-out  is  used  for  quick 
checks  of  the  system  (i.e.,  verification  of  revised  calibration  data, 
guarantee  that  total  recording  system  is  operating  accurately,  etc.) 
and  preliminary  measurement  research.  The  data  are  printed  in  columns 
using  three  pages  to  represent  50  seconds  of  data. 

An  illustration  of  the  print-out  format  is  provided  in  Appendix  II. 
Recorded  time  is  printed  in  the  left-most  column  of  all  pages.  Page  1 
(of  every  3  pages)  is  used  to  present  all  variables  normally  associated 
with  movement  about  the  lateral  axis  of  the  aircraft.  Page  2  presents 
variables  associated  with  movement  about  the  longitudinal  or  vertical 
axes.  Page  3  presents  engine  and  discrete  variables,  the  event 
number,  computed  time,  and  a  record  number. 

f.  Calibration  Software 

The  calibration  programs  are  listed  in  Appendix  III.  A  main 
program  and  seven  subroutines  were  developed  to  (a)  calibrate  the  data; 
(b)  write  the  calibrated  data  on  magnetic  tape;  and  (c)  print  the 
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calibrated  data  at  one  sample 

per  second.  The  program's  approximate 

number  of 

statements  (including  comments  and  data) 

,  and  main  function  of 

each  are 

as  follows: 

PROGRAM 

LANGUAGE 

STATEMENTS 

FUNCTION 

Main 

Fortran 

108 

Control  program 

Cyclex 

Calbrt 

Aitken 

Fortran 

Fortran 

Fortran 

60 

Ul 

111 

> 

Extract,  calibrate, 
and  store  data  in 
100-word  blocks 

Stores 

Fortran 

19 

Array-storage 

Selecx 

Fortran 

54 

Arrays  data  for 
printout  and  calls 
print  when  page  is 
full 

Prints 

Fortran 

40 

Prints  data,  1/sec 

Xtratc 

Map 

87 

> 

IOCS 

Map 

171 

►  Tape  handling 

Units 

Map 

17 

4 

Routines 

TOTAL :  711 
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SAMPLING  RATE  STlfDY 


1 .  INTRODUCTION 

At  the  onset  of  this  study,  a  decision  had  to  be  made  regarding  the 
in-flight  sampling  rate  which  would  be  adequate  for  purposes  of 
performance  measurement.  Error  in  one  direction  would  result  in 
redundant  data,  contributing  to  the  already  difficult  problem  of  data 
handling.  Error  in  the  opposite  direction  would  result  in  a  lack  of 
sufficient  data  to  accomplish  the  research. 

The  popular  existing  approach  to  determining  required  sampling  rates 
is  to  base  the  decision  on  sampling  theory,  which  relates  the  worst  case 
natural  frequency  of  the  aircraft  to  the  sampling  rate  that  effectively 
allows  the  entire  "waveform"  to  be  reproduced.  This  approach  has  been 
employed  for  years  in  the  area  of  flight  simulation.  However,  it  is 
conceivable  that  such  an  approach  would  only  guarantee  the  sufficiency, 
not  the  necessity,  of  the  amount  of  data  to  be  recorded.  This  is 
particularly  true  in  light  of  the  present  intended  use  of  the  data, 
i.e.,  performance  measurement  of  selected  flight  maneuvers. 

For  lack  of  better  guidelines,  the  sufficiency  of  10  and  100  times- 
per-second  sampling  rates  was  intuitively  assumed  for  launching  the 
present  study.  An  investigation  of  the  necessity  for  such  rates  for 
those  flight  variables  relevant  to  measurement  on  each  flight  maneuver 
is  required,  however,  before  specification  of  an  optimal  recording 
system  can  be  made.  In  support  of  this,  an  initial  sampling  rate  study 
was  conducted,  the  primary  purpose  being  to  establish  a  methodology  for 
such  investigations. 
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2.  APPROACH 

a.  Discussion 

The  recorded  data  were  sampled  at  a  number  of  different  sampling 
intervals  (e.g.,  every  0.05  seconds,  every  0.01  seconds,  etc.).  For 
each  test  run,  or  each  sampling  interval  used,  tests  were  made  to 
determine  the  errors  that  would  result  from  generating  the  between- 
sampling-interval  data  from  the  sample-points  using  linear  interpolation. 
In  other  words,  the  question  addressed  was,  "If  the  only  data  available 
were  those  values  sampled  at  an  interval  of  n  seconds,  and  intermediate 
data  were  then  generated  using  those  sampled  values,  what  errors  could  be 
expected  in  the  generated  data?"  Figure  7  illustrates  this  concept. 


Time 


Figure  7.  Nature  of  Error  Computation  for  Sampling  Rate  Study 
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As  a  test  case  for  the  study,  pitch  angle  was  examined  during  the 
performance  of  (a)  46  lazy  8  maneuvers  and  (b)  44  barrel  roll  maneuvers. 
Pitch  was  recorded  in-flight  at  a  sampling  interval  0.01  seconds. 

Sampling  intervals  of  0.05,  0.10,  0.50,  1,  2,  3,  4,  and  10  seconds  were 
tested.  An  error  distribution  (histogram)  for  each  maneuver  and  each 
sampling  interval  was  then  constructed. 

b.  Software 

Appendix  IV  presents  the  FORTRAN  program  listings  of  routines 
used  in  the  experiment.  Portions  of  a  typical  print-out  are  presented 
in  Figure  8.  In  Figure  8a,  the  first  seven  columns  present  (1)  the 
event  number  (ENV0)  of  the  maneuver;  (2)  sampling  rate  tested;  (3)  the 
total  number  of  points  comprising  the  maneuver  as  recorded  on  tape; 

(4)  the  "resolution"  error  (RES)  tested,  which  was  the  tolerance  within 
which  an  error  was  not  counted  and  beyond  which  it  was  counted  (RES  set 
to  zero  for  this  application);  (5)  the  number  of  times  a  tested  point 
produced  an  error  which  exceeded  RES;  (6)  the  worst  error  (one  with 
largest  magnitude)  encountered;  and  (7)  the  time  into  the  maneuver 
(seconds)  at  which  the  worst  error  occurred.  The  remaining  twelve 
columns  present  the  number  of  errors  whose  absolute  value  lay  in  the 
range  indicated  at  the  top  of  the  respective  column. 

Figure  8b  summarizes  the  data  in  terms  of  fractional  parts.  The  3rd 
column  presents  the  part  of  all  samples  tested  in  which  any  error  was 
detected.  Subsequent  columns  present  the  part  of  all  samples-in-error 
in  which  error  magnitudes  fell  in  the  indicated  range. 

Since  the  two  types  of  maneuvers  to  be  examined  were  intermixed  on 
several  different  tapes,  it  was  most  expedient  to  compute  the  summary  of 
all  data  by  hand,  following  the  several  necessary  computer  runs.  Each 
computer  run  produced  results  as  shown  in  Figure  8  for  all  lazy  8's  and 
barrel  rolls  on  one  tape,  plus  additional  computations  which  aided  the 
hand-summarization  (by  maneuver)  of  all  data. 
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3.  RESULTS 

Table  VI  summarizes  the  results  obtained  for  the  lazy  8  and  barrel 
roll  pitch-angle  sampling  rate  study.  The  heavy  line  indicates  the 
boundary  which  delineates  the  point  in  the  error  distribution  where  an 
asymptote  is  apparently  reached.  (The  results  must  be  interpreted  in 
terms  of  this  asymptote  rather  than  solely  in  terms  of  the  number  of 
errors  within  certain  bounds  because  of  the  existence  of  data  spurs,  or 
glitches. 

Table  VI  suggests  that  for  the  lazy  8,  little  would  be  gained  using 
a  sampling  interval  smaller  than  1.0  seconds.  Increasing  the  interval 
from  1.0  to  2.0  would  effectively  double  the  worst-case  error.  For  the 
barrel  roll,  an  interval  smaller  than  0.10  seconds  would  apparently  be 
unnecessary.  A  slight  increase  in  worst-case  error  would  be  experienced 
in  a  sampling-interval  increase  from  0.1  to  0.5  or  1.0.  The  real 
breakpoint  occurs  with  intervals  at  2  seconds  or  larger. 

It  would  appear,  then,  that,  for  pitch-angle,  a  sampling  rate  of 
1  per  second  for  both  maneuvers  would  be  optimal,  with  slightly  improved 
accuracy  possible  in  the  barrel  roll  by  going  to  10  per  second.  (Of 
course  this  investigation  considered  only  a  discrete  set  of  test  intervals, 
and  a  more  thorough  study  may  show  a  5  or  7  per  second  rate  optimal  for 
the  barrel  roll.)  If  the  pitch  accuracy  tolerance  were  +2°  for  both 
maneuvers,  then  a  rate  of  2  per  second  on  the  lazy  8  and  1  per  second  on 
the  barrel  roll  would  probably  be  required. 

This  type  of  information  is  of  some  benefit  both  for  specifying 
recording  systems  and  for  performing  measurement  analyses.  Figures  9 
and  10  show  how  the  data  can  be  presented  graphically  to  provide 
immediate  indication  of  the  adequacy  of  any  proposed  sampling  rate  for 
various  error  tolerances.  Using  Figure  9,  for  example,  it  is  easy  to 
discern  the  sampling  intervals  which  would  provide  comparable  results 
for,  say,  an  error  tolerance  of  +2°. 
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TABLE  VI 


FRACTIONAL  PART  OF  PITCH  ERRORS  <  x  FOR 
VARIOUS  Xl  VALUES 


Error  Magnitude  (x) 


Lazy  8  (N  =  46) 


0.5 

1.0  I 

1.5 

2.0 

2.5 

3.0 

3.5 

4.0 

5.0 

10.0 

.960 

.988 

.991 

.991 

.991 

.991 

.992 

.992 

.992 

.993 

.968 

.988 

.991 

.991 

.991 

.991 

.991 

.992 

.993 

.942 

.987 

.991 

.991 

.991 

.991 

.992 

.992 

.993 

.913 

.984 

.991 

.991 

.991 

.992 

.992 

.992 

.993 

.711 

.917 

.971 

.986 

.989 

.990 

.991 

.991 

.991 

.992 

.506 

.731 

.920 

.956 

.972 

.980 

.  id*  | 

.  939 

.990 

.376 

.580 

.697 

.778 

.844 

.895 

.930 

.949 

.967 

.987 

.121 

.204 

.274 

.334 

.387 

.432 

.471 

.503 

.552 

.753 

Er» 

■or  Magnitude  (x] 

Bar 

rel  R< 

>11  (N 

=  44) 

im 

1.0 

1.5 

2.0 

2.5 

3.0 

3.5 

4.0 

5.0 

10.0 

.960 

.985 

.988 

.989 

.990 

.991 

.991 

.991 

.993 

.961 

.983 

.986 

.987 

.988 

.988 

.988 

.989 

.989 

.991 

.923 

.974 

.982 

.985 

.985 

.986 

.986 

.986 

.987 

.988 

.861 

.962 

.980 

.984 

.985 

986 

.986 

.987 

.987 

.989 

.639 

.813 

.887 

.926 

.949 

.963 

.974 

.979 

.983 

.988 

.477 

.674 

.768 

.820 

.855 

.881 

m 

.924 

.948 

.984 

.361 

.538 

.637 

.703 

.784 

.811 

.832 

.871 

.967 

1  .098 

.173 

.239 

.299 

.353 

.392 

.428 

m 

.506 

.649 

.05 

.10 

.50 

1.0 

2.0 

3^0 

4.0 

10. 


.05 

.10 

.50 

1.0 

2.0 

3.0 

4.0 

10. 


\  represents  the  error  magnitude.  The  table  shows  the  fractional 
part  (how  many)  of  the  total  errors  that  were  <  x  at  each 
sampling  interval  tested.  For  example,  at  A  =  1.0  (la^y  o), 
98.4%  of  the  errors  incurred  were  <1.0  in  magnitude. 
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Figure  9.  Sampling  Interval  Plot  for  Pitch  (Lazy  8,  H  *=  46) 
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In  addition  to  developing  the  type  of  data  presented  here,  the 
sampling  rate  analysis  could  include  a  matching  of  the  error  distribution 
to  the  portion  of  the  maneuver  being  flown.  for  this  purpose,  maneuver- 
sections  could  be  delineated  using  a  Boolean  Time  Function  approach, 
wherein  necessary  and  sufficient  conditions  for  each  state  or  group  of 
states  of  the  aircraft,  relating  in  turn  to  sections  of  the  maneuver, 
are  identified  using  logical  operators  (Reference  3).  This  could  lead 
to  an  identification  of  the  portions  of  the  maneuver  which,  from  a 
sampling-rate  standpoint,  load  the  requirements  most  heavily.  These 
portions  may  or  may  not  be  critical  in  performance  measurement  and, 
hence,  the  sampling  rate  may  be  adjustabl  for  a  reduction  of  requirements. 
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SECTION  V 

BASIC  PERFORMANCE  MEASUREMENT  SYSTEM 

1.  GENERAL  APPROACH 

The  approach  consisted  of  several  distinct  but  interrelated  tasks. 
Summarily,  these  tasks  were: 

1.  Perform  analysis  of  the  maneuvers  to  be  studied  in  detail. 

2.  Develop  theoretical  measures  based  strictly  on  the  results 
of  the  analyses. 

3.  Compute  the  theoretical  measures  for  representative 
performances  to  determine  which  measures  have  face-validity. 

4.  Develop  experimental  measures  consisting  of  (a)  those 
theoretical  measures  which  appear  valid  and  (b)  other  measures  derived 
through  examination  of  the  data. 

5.  Compute  the  experimental  measures  for  a  broad  sample  of 
student  and  instructor  data  and  perform  analyses  to  validate  the  measures. 

The  maneuver  analyses  were  performed  by  Air  Training  Command.  The 
analyses  included  (1)  a  maneuver  description,  (2)  an  itemization  of 
maneuver  elements,  or  separate  portions  of  the  maneuver,  and  (3)  for 
each  maneuver-element,  the  primary  pilot  tasks,  the  knowledge  and  skill 
required,  and  suggested  error  tolerances  on  critical  parameters. 
Supplementing  the  information  provided  in  the  Primary  Flying  Manual 
(Reference  4),  the  task  analyses  provided  a  fair  "picture"  of  each 
maneuver  in  addition  to  an  indication  of  Air  Training  Command  standards 
of  performance,  insofar  as  it  was  possible  at  that  time  to  quantify  these 
standards . 

Theoretical  measures  were  then  developed  based  on  the  maneuver- 
analyses.  This  was  accomplished  during  the  instrumentation/test  flight 
phases  of  the  study,  so  that  quite  early  in  the  preliminary  data- 
collection  phase,  measurement  programs  were  available  to  enable  data 
analysis  and  research  to  be  initiated. 
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These  preliminary  measurement  ptograms  were  applied  to  early 
perro»inances  of  the  Flight  Test  pilots.  The  resulting  data  were 
analysed  to  determine  expected  ranges  of  the  critical  flight  parameters 
and  evaluate  the  face  validity  ot  the  various  theoretical  measures. 
Also,  those  portions  of  the  maneuvers  and/or  those  pilot  skills  which 
seemed  the  most  feasible  candidates  for  automated  measurement  were 
i don 1 i tied. 


Final  measurement  programs  were  then  developed  for  analysis  of  each 
student  and  i ns Lr uctor/pilot  performance.  These  programs  computed  a 
variety  of  experimental  measures  believed  to  be  relevant  to  performance 
evaluation.  In  addition,  they  produced  automated  plots  of  certain 
combinations  of  variables  to  pro  ’u  e  a  "picture"  of  the  most  relevant 
reature.'.  of  each  performance. 

The  remainder  of  this  Section  is  devoted  to  a  description  of  how 
each  of  the  above  tasks  was  accomplished  and,  where  applicable,  how 
measurement  programs  were  implemented 


2.  ATC  MANEUVF.9  ANALYSIS 
a.  Lazy  8 

( 1 )  Sener al  Descri pti on 

Th<  lazy  8  is  a  maneuver  requiring  simultaneous  turning 
uric  climbing  or  descending  sc  that  a  horizontal  figure  eight  is  described 
about  a  selected  reference  point  located  on  the  horizon. 

This  analysis  assumes  that  the  amraft  is  in  the  local  flying  area 
in  level  flight  between  maneuvers. 

Also  assumed  is  that  the  student  is  in  a  post-solo  phase  of  the 
T-37,  is  able  to  control  the  aircraft  in  turns  of  specified  bank  angles, 
a i id  to  maintain  straight  and  level  Might. 
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Tor  analysis  purposes,  the  heading  indicated  on  the  compass  should 
t  u-ed  as  a  primary  reference  although  the  student  will  perform  the 
at, ewer  using  outside  references. 

1  Maneuver  Elements 

Figure  11  illustrates  the  nine  maneuver  elements  of  the  lazy  8. 
Of.  element,  numbers  coincide  with  the  circled  task  analysis  numbers 
(T  ible  VII). 

(?)  Maneuver  Analysis 

Table  VII  presents  the  analysis  of  the  lazy  8  as  developed  by 
h',  Training  Command. 

b.  Eiar'^1  Ro  1 1 

(1)  General  Description 

The  barrel  roll  consists  of  an  aerobatic  roll  maneuver  of 
■'  rank  about  a  selected  reference  point  located  ahead  of  the  aircraft. 

The  student  must  maintain  a  constant  angle  off  a  selected  reference 
i . f.  through  the  360°  of  bank  with  constantly  changing  pitch  attitudes 
.  reeds. 


Positive  seat  pressures  must  be  maintained  and  foil  must  be 


The  student  must  coordinate  rudder,  elevator,  .and  aileron  deflection 

frur  normal  . 


{?)  Maneuver  E 1 omo * ’s 

The  maneuver  is  divided  into  five  seomerits  (Figures  12a 

tht  .'ugh  lie): 

1.  .  v.  •  .•  m  ;s  !  1  civ-,  i ,  t- j  »tr  inteirai  cart  of  the 

r"M  ,  but  is  mjici  taiit  for  t  . f ,  i  •  rt  mer  p  point  and 
r;,t  ■>!  . sh  '  lieuvor  cnentat  >( 
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1  Maneuver  entry 

2  45°  turn  point 

3  90°  turn  point 

4  135°  turn  point 

5  180°  turn  point  (midpoint  of  maneuver) 

6  135°  turn  point  (direction  opposite  from  0.1-0. 5) 

7  90°  turn  point 

8  45°  turn  point 

9  Maneuver  termination  (straight  and  level  flight) 


Figure  11.  Lazy  8  Maneuver  Profile 
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TABLE  VII  (Concluded) 


I 

g 

-J 

I 

IQ 

g 

«o 

</) 

l/> 

in 

in 

i 

ia 

g 

q 

g 

|Q 

g 

♦o 

m 

m 

in 

in 

g 

•Q 

g 

to 

«5 

uO 

m 

in 

AFHRL -TR-72-6 


Figure  12a.  Maneuver  Start  Figure  12b.  90°  Roll  Point 


Figure  12e.  Maneuver  End 


Figure  12.  Barrel  Roll  Positions 
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2.  First  quarter  roil  {0  -  90°  roll) 

3.  Second  quarter  roll  (90  -  180°  roll) 

4.  Third  quarter  roll  (180  -  270°  roll) 

5.  Fourth  quarter  roll  (270  -  360°  roll) 

(3)  Maneuver  Analysis 

Clearing  the  Area.  This  ensures  visually  that  no  other 
aircraft  flight  path  would  be  in  a  position  to  conflict  with  maneuver 
area.  It  can  be  accomplished  by  a  180°  turn  or  two  medium  (40°)  to 
steep  (60°)  banked  turns  in  opposite  directions  of  sufficient  duration  to 
visually  clear  the  maneuver  area. 

Selection  of  Reference  Point.  The  reference  point  is  usually  an 
isolated  cloud  formation  of  small  size  or  a  section  line  stretching  to 
horizon.  The  selected  point  must  be  easily  identifiable  and  should 
contrast  enough  with  surroundings  so  the  student  has  no  difficulty  in 
keeping  an  eye  on  it. 

Entry  to  Barrel  Roll.  After  selection  of  the  reference  point,  the 
throttles  are  adjusted  to  90%.  The  nose  of  the  aircraft  is  then  lowered 
below  the  reference  point  to  attain  an  airspeed  of  200  to  230  knots. 

The  aircraft  is  then  rolled  right  or  left  with  the  aircraft  continuing 
the  descent  until  20-30°  to  one  side  of  the  reference  point.  The  wings 
are  then  rolled  level  to  simultaneously  allow  the  aircraft  nose  to  come 
to  level  flight  attitude. 

First  Quarter  of  Roll .  The  student  notes  his  angle  off  the  reference 
point.  This  angle  alpha  (a)  is  between  a  line  parallel  to  the 
longitudinal  axis  of  the  aircraft  projected  forward  from  the  pilot  and  a 
line  projected  to  the  reference  point.  This  reference  point  should 
remain  in  the  same  position  on  the  windscreen  throughout  the  maneuver 
regardless  of  aircraft  attitude.  A  climbing  turn  is  executed  toward 
the  reference  point  to  simultaneously  reach  90°  of  bank  when  the  nose 
is  alpha  (a)  degrees  above  the  horizon.  At  this  point,  the 
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longitudinal  axis  of  the  aircraft  should  be  in  the  vertical  plane  which 
passes  through  the  reference  point.  Constancy  of  roll  rate  is  the  major 
difficulty  in  thic  task  segment.  Control  deflection  must  be  increased 
to  compensate  for  decreasing  airspeed. 

Second  Quarter  of  Roll,  The  aircraft  is  rolled  to  an  inverted  level 
flight  position  (180°  bank,  0°  pitch)  to  the  angle  a  off  the  reference 
point.  Although  pitch  attitude  is  decreasing,  aircraft  airspeed  is 
continuing  to  decrease.  Increased  aileron  deflection  is  therefore 
necessary  to  keep  roll  rate  constant.  Back  pressure  is  still  necessary 
during  the  initial  portion  of  this  maneuver  segment  to  turn  the  aircraft 
to  the  proper  angle  off.  As  the  aircraft  approaches  135°  of  bank, 
elevator  control  deflection  is  now  decreased  since  lift  on  the  wings  is 
being  exerted  in  the  same  direction  as  the  force  of  gravity. 

Third  Quarter  of  Roll.  The  roll  is  continued  from  wings-lcvel 
inverted  position  to  90°  of  bank  and  a  diving  angle  equal  to  angle  a. 

At  this  270°  of  roll  point,  the  longitudinal  axis  of  the  aircraft  is 
again  in  the  vertical  plane  through  the  reference  point.  During  the 
roll  of  135°  of  bank,  back  pressure  is  nominal  because  lift  is  still 
being  generated  in  a  downward  direction.  As  the  135°  roll  point  is 
reached,  back  pressure  is  slowly  increased.  Aileron  deflection  from 
the  180°  roll  point  is  decreased  as  airspeed  begins  to  increase  to  keep 
roll  rate  constant. 

Fourth  Quarter  of  Roll.  The  aircraft  is  now  rolled  from  270°  bank 
and  diving  attitude  to  the  erect  position.  The  reference  point  should 
again  be  equal  to  angle  a.  From  the  270°  bank  point,  aileron  deflection 
will  continue  to  decrease  whiie  back  stick  pressure  will  increase  to 
decrease  the  dive  angle.  Roll  out  of  bank  and  back  pressure  should  be 
coordinated  to  properly  come  to  level  flight  and  angle  a,  simultaneously. 
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(a)  Performance  Tolerances 

Follow!  ig  are  estimates  of  realistic  performance  tolerances 
for  some  of  the  more  relevant  variables  of  this  maneuver. 

Segment  Variable 

1  RPM  ? 

Entry  IAS  2 

Minimum  Altitude 
Offset  of  nose  from 
reference  point 

2-5  RPM 

(4-quarters)  g  Force 

Angle  off  (alpha) 
between  nose  and 
reference  point 


cinn-if Performance  Factors 


Range 

100  to  260  knots 

Entry  Heading,  20  to  60°  off 
reference  point 

90%  +1% 

0  -  360° 

+10% 

l  <  g  <4 


control  movement 


2It  is  mandatory  that  at  least  200  knots  IAS  be  attained  for  entry. 
Maneuver  will  not  be  started  or  terminated  below  5000  ft. 


Quantitative  Factors: 
Variabl e 

1.  Airspeed 

2.  Heading 

3.  RPM 

4.  Degree  of  Bank 

5.  Angle  Off  (alpha)  Error 

6.  g  Force 

Qualitative  Factors: 

1.  Smoothness  in  coordinated 
’  2.  Continuity  of  maneuver 


Tol erance 

90%  +1% 
200-230  knots 
5000  ft  AGL 
20°  ><  60° 


90%  +1% 

constant  1  ><  4g 
+10% 
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3.  Quickness  in  discerning  and  applying  the  required  control 
movements  in  various  aircraft  orientations. 

4.  Confidence  and  positiveness  in  controlling  aircraft. 

c.  Normal  Landing 

Although  detailed  analysis  in  the  study  was  limited  to  the  lazy  8 
and  barrel  roll  maneuvers,  an  analysis  of  the  normal  landing  was  also 
developed.  Some  preliminary  work  requisite  to  measurement  research  on 
the  landing  task  has  also  been  accomplished.  The  task  analysis  and 
preliminary  follow-up  analysis  are  documented  below. 

(1)  General  Description 

A  circular  approach  to  the  active  runway  consisting  of: 

1.  An  initial  approach  to  the  active  runway  1000  ft  AGL 
(above  ground  level) 

2.  A  level  180°  turn  with  simultaneous  reduction  of  airspeed 
to  a  downwind  position 

3.  Speed  brake,  landing  gear,  and  flap  lowering 

4.  A  descending  180°  turn  to  align  with  the  active  runway 

5.  A  glide  path  to  the  touchdown  point  in  the  first  1000  ft 
of  the  runway. 

This  analysis  assumes  the  student  is  in  early  stage;  of  aircroct 
checkout  through  termination  of  T-37  flying. 

Also  assumed  is  that  the  student  is  capable  of  level  flight,  turning 
level  flight  with  airspeed  changes,  and  descending  turns  while  maintaining 
airspeed. 
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Displacement  from  runway  (ground  track)  cannot  be  taken  from  aircraft 
instrumentation4  and  would  necessarily  be  a  result  of  instructor  verbal 
i nput. 

(2)  Maneuver  Elements 

Figure  13  illustrates  the  six  maneuver  elements  of  the  normal 

landing. 

(3)  Maneuver  Analysis 

Table  VIII  presents  the  task  analysis  of  the  normal  landing 
as  developed  by  Air  Training  Command. 

(4)  Extended  Analysis  of  Normal  Landing 

By  utilizing  the  maneuver  analysis,  information  in  the  primary 
flight  manual  (Reference  4),  and  personal  knowledge  of  the  normal  landing 
task,  we  developed  an  extended  analysis  of  the  task.  This  was 

accomplished  as  a  first  step  in  (a)  properly  segmenting  the  maneuver 

for  measurement  purposes  and  (b)  identifying  basic  ATC  criteria  as 
they  apply  to  various  segments  of  the  task.  The  results  are  presented 

in  Appendix  V. 


3.  THEORETICAL  MEASURES 

Theoretical  measures  were  developed  using  maneuver-analysis  data  for 
the  lazy  8  and  barrel  roll  maneuvers.  These  measures  constituted  a 
"first  guess"  at  an  appropriate  set  of  measures  and  were  based  solely 
upon  ATC  criteria.  Their  computation  was  accomplished  through  the 
development  of  appropriate  software,  which  was  then  used  to  compute  the 
theoretical  measures  for  a  sample  of  flight  test  pilot  performances. 

The  following  paragraphs  are  devoted  to  a  description  of  the  theoretical 
measures  and  the  rationale  underlying  their  development,  the  implementati 
of  software  for  their  computation,  and  initial  tests. 


^Instrumentation,  for  this 
ground  track. 


study,  did  not  include  a  means  of  determining 
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Figure  13.  Normal  Landing  Maneuver  Profile 
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held  level,  drift  correction  correction  If  necessary, 

maintained,  if  necessary. 
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a.  Description 
(1)  Lazy  8 

As  suggested  by  ATC,  the  primary  reference  variable  in  this 
maneuver  (for  purposes  of  developing  theoretical  measures)  was  aircraft 
heading.  Criteria  for  most  other  variables  were  functions  of  heading. 

The  criterion  for  heading  itself  was  computed  as  a  function  of  the  initial 
heading  selected  by  the  pilot  upon  entering  the  maneuver. 

The  lazy  8  is  a  maneuver  consisting  of  two  symmetrical  parts. 
Therefore,  criteria  and  initial  measurement  methods  were  developed  only 
for  the  first  half  of  the  maneuver,  but  were  applicable  to  the  second 
half  as  well.  Theoretically,  we  may  regard  the  lazy  8  as  two 
successive  performances  of  a  "half  lazy  8,"  both  done  in  opposite 
directions  and  with  smooth  transition  and  no  hesitation  between 
performances . 

Figure  14  and  Table  IX  together  sketch  the  maneuver  and  the 
performance  criteria  suggested  by  ATC  in  their  maneuver  analysis. 

This  information  was  used  in  developing  mathematical  expressions  for 
the  criteria  and  tolerances  for  bank,  pitch,  vertical  velocity,  airspeed, 
altitude,  g's,  and  RPM.  Then  measures  were  developed  based  on  a 
comparison  of  recorded  data  with  criteria  and,  where  applicable,  with 
tolerances. 

The  following  discussion  presents,  first,  the  individual 
theoretical  measures  (denoted  S^)  developed  for  each  aircraft  variable. 
These  S..  measures  indicate  how  much  the  performance  differed  from  ATC 
criteria,  and  where  applicable,  tolerances. 

Next,  combined  theoretical  measures  are  described.  These  consist 
of  linear  combinations  of  selected  S.  measures  to  provide  a  single 
measure  for  each  of  several  aspects  of  the  performance.  One 
combination  measure,  for  instance,  reflects  how  well  the  pilot's 
transition  from  descent  to  level  flight  at  the  180°  turn  point  is 
synchronized  with  the  transition  to  zero  bank  angle. 
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Finally,  a  "total  score"  is  developed  from  the  combination  measures 
to  provide  a  single  indicant  of  total  performance.  This  is  a  weighted 
sum  of  the  combination  measures,  with  the  weights  consisting  of  "best 
guesses"  for  this  theoretical  measures  development. 

(a)  Bank  Angle 

To  express  mathematically  the  criteria  and  tolerances 
relevant  to  bank  angle,  linear  relationships  have  been  established 
between  Bank  (B)  and  Turn  (T)  from  the  information  in  Table  IX. 

When  turn  is  15°,  bank  should  be  13  -  15°;  when  turn  is  30°,  bank 
should  be  27  -  30°,  etc.  Since  it  is  desirable  to  have  a  continuous 
bank  criterion,  and  not  just  a  check  at  discrete  turn-points,  a  function 
relating  bank  to  turn  would  be  preferable.  This  also  simplifies 
programming  (easier  to  code  one  function  than  to  do  table  look-ups  and 
interpolation).  The  functions: 

Bank  =  Turn  or  B  =  T 

8  8 

and  Bank  -  -g-  Turn  or  B  *  g-  T 

approximately  represent  the  upper  and  lower  bounds  for  bank  angle  for 
all  points  of  turn  from  0  to  90°.  Therefore,  the  criterion  for  this 
region  is: 


~  T  <  B  <  T 

The  tolerance  for  bank,  as  provided  in  Table  IX,  is  +4°.  Therefore 
(T  +  4)  and  (■§■  T  -  4)  represent  the  upper  and  lower  tolerances. 

Similar  analysis  was  performed  for  90  to  180°  turn  region  and  the 
following  mathematical  expressions  for  criteria  and  tolerances  were 
derived: 

For  0°  £  T  <  90°: 

|t-4<{|t<B<t}  <  T  +  4  (1) 
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► 


For  90°  <  T  <  180°: 

|  (175.5  -  T)  <  {I  (180  -  T)  <  B  <  180  -  T  }  <  184  -  T  (2) 

where  T  =  the  degrees  of  turn  made  (i.e.,  degrees  of  heading-change) 
and  B  =  the  angle  of  bank. 

In  inequal  Uies  (1)  and  (2)  above,  the  most  extreme  quantities 
represent  tolerance  limits,  while  the  criteria  themselves  are  represented 
by  the  portions  of  the  inequalities  within  brackets. 

The  measures  desired  for  bank  angle  should  reflect  (1)  whether  or 
not,  and  to  what  extent,  the  basic  criteria  are  satisified,  and 
(2)  whether  or  not,  and  to  what  extent,  the  tolerances  are  exceeded. 
Separate  measures  are  desired  for  each  of  these  considerations,  because 
different  weights  may  be  required  in  performance  evaluations  depending 
upon  whether  criteria  are  not  satisfied,  but  tolerances  are;  or  whether 
neither  is  satisfied. 


B,  -  T,  ,  T,  <  90,  AND  B,  >  T, 

1  T,  -  B)  ,  Tj  <  90  ,  AND  B,  <  J-  T( 

-  180  +  T,  ,  T,  >  90,  AND  B,  >  ISO  -  T, 

0 

g-OBO-T,)  -  B,  ,  T,  >  90,  AND  B,  <  f-  (180 -T,) 
^0  ,  otherwise 


where  the  subscript  i  refers  to  the  value  of  the  variable  at  the  ith 
sampling  instant. 


5 

x 


L 

K 


is  interpreted 
K  is  true. 


as  follows: 


X 


Y  if  L  is  true  and  X  =  Z  if 
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Let 


B(  -  T,  -  4  ,  T,  <  90,  AND  B,  >  T(  +4 


i  'I 


f  T,  -  4  -B,  ,  T,  <  90,  AND  B,  <  f  T,  -4 


'  I 


N,  =  <B,  -  184  +  T,  ,  T,  >90,  AND  B,  >  184  -  T, 


f- (175.5  -T,)  -  B,  ,  T,  >  90,  AND  B,  <  ■§  (175.5  -  T,  ) 
0  ,  otherwise 


The  values  and  respectively  provide  the  amount  by  which  criteria 
are  exceeded  and  the  amount  by  which  tolerances  are  exceeded.  Integrating 
each  of  these,  we  obtain: 


i,  =  /  M, 


dT 


i,  =/n, 
0 


dT 


Sj  is  an  integrated  error  measure  showing  the  extent  to  which  bank 
criteria  are  exceeded;  So,  similarly,  shows  the  extent  to  which  bank 
tolerances  are  exceeded. 

(b)  Pitch  Angle 

The  required  pitch  angle  has  been  established  by  ATC  as  a 
function  of  the  maximum  pitch  angle  attained  in  the  maneuver  (Table  IX). 
Call  this  maximum  pitch  angle  H.  As  indicated  in  Table  IX,  pitch  should 
reach  its  maximum  (H)  at  the  45°  turn  point,  should  then  decrease  to 
zero  by  the  90°  turn  point,  should  reach  its  negative  maximum  (-H)  at 
the  135°  turn  point,  and  should  then  return  to  zero  again  at  the  180° 
turn  point.  The  change  in  pitch  should  be  a  linear  function  of  the 
degree  of  turn. 
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The  following  criterion  inequalities  were  computed  from  the 
information  in  Table  IX.  As  in  the  case  of  bank  angle,  the  portions  of 
the  inequalities  within  brackets  represents  the  basic  criteria,  whereas 
the  portions  outside  the  brackets  represent  tolerances. 


Let  P  =  Pitch  Angle 
and  T  =  Degrees  of  Turn: 


For  0°  <  T  <  45° : 


0-9HT  <  f_HT 

45  “  145 


For  45°  <  T  <  90°: 


JJ  H  (1-180)  <  f  _  H  ( T  —  ISO )  _  p  1  <  0,9H  (T-  1801 

45  l  45  J  "  45 

The  performance  measures  desired  should  reflect  the  deviation  from  the 
criteria  plus  any  deviation  outside  the  tolerance  limits. 
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Let 


I  p  -  Jttl  I  T  <  45  AND 
I  |  ) 

0.9HT  <  p  <  I.IHT 
45  “  45 

|p-  H  t.99  - 1.1  j  45  <  T  <90  AND 

0.9H  +  (T-45)^.jL.0,„9Hi  <  p  <  +  iI^2UjLJJiU 


|p  _  H(9°s"  T).|  90  <  T  S  135  AND 

(T-90U0.9H+5)  .  _  .  (T-90MUH-5)  .  « 

5SPS  49 

L  _  H(T-I80)  I  T  >  |3S  AND 
I  45  *  » 

1T- *°.9h<ps  ItdBSffirJm + 


For  each  sampling  instant,  i,  the  ^  above  reflects  the  absolute  value 
of  the  difference  between  the  actual  and  criterion  pitch  angles  whenever 
tolerances  are  not  exceeded. 
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Let 


N, 


p  ~  *  T  <  45  AND  P  > 


0.9  HT 

45 


-  p  ,  T  <  45  AND  P  <  0  9  HT 


45 


p  _  -LLH,t90  ~  T )  ,  45  <  T  <  90  AND 


P  > 


I.IH  (90-T) 
45 


0.9  H  (90  -T) 
45 


-  P  •  45  <  T  <  90  AND 


p  <  0.9H  (90-T) 

45 


p  _  J.I  H  (90-T)  ,  go  <  T  <  |35  AND 
45 


p  >  »  IH  (90-T) 

45 
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and 


°’9  H  45~T~  “  p  .  90  <  T  ^  135  AND 

p  <  0-9  H  (90  -T) 

45 


p  _  11  H(T  ‘l0!-  ,  T  >  135  AND 

45 


P  > 


l.l  H  (T  -  180) 
45 


0.9  H  (T  -  180).  _  p  ^  j  >  |35 
45 


AND 


P  <  0.9  H  (T- 180) 

45 

For  each  sampling  instant,  i,  the  above  reflects  the  amount  by  which 
tolerances  are  exceeded.  Integrating,  we  obtain  the  following  measures: 


i,  *  /' M, 


dT 


,T 

s4  =  J'n, 


dT. 


and  are  integrated  error  measures  showing  the  extent  to  which 
pitch  criteria  and  tolerances,  respectively,  are  exceeded. 


(c)  Vertical  Velocity 

Based  on  the  information  in  Table  IX,  vertical  velocity  (V/V) 
should  be  zero  at  the  0°,  90°,  and  180°  turn  points.  Further,  V/V 

should  be  positive  from  T  =  0°  to  T  =  90°  and  negative  from  T  =  90°  to 
T  =  180°.  There  is  no  tolerance  for  error. 
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Let  Rt  =  V/V  when  turn  =  0° 

R2  =  V/V  when  turn  =  90° 

=  V/V  when  turn  =  180° 


Then  one  measure  may  be  computed  as: 

s»  *  lRi  I  +  'M  +  Irb| 

This  gives  us  the  sum  of  absolute  vertical  velocity  errors  at  the  0°, 
90°,  and  180°  turn  points. 

Let 


I  V/v|  ,0  <  T  <  90  AND  V/V  <  0 
V/V,  90  i<  T  <  ISO  AND  V/V  >  0 


0,  otherwise 


Then 


Where  time  is  number  of 
seconds  for  that  half  of 
the  maneuver. 


This  gives  the  integral  error  on  the  V/V  direction  from  T  =  0°  to  T  -  180°. 


One  other  aspect  of  V/V  needs  to  be  checked.  The  V/V  should  become 
zero  at  the  180°  turn  point  at  the  same  time  that  the  angle  of  bank 
becomes  zero.  Neither  should  occur  before  the  other. 


Let  T-|  =  the  time  at  which  V/V  first  becomes  zero  when  135°  <  T  <  180° 
and  T^  =  the  time  at  which  bank  first  becomes  zero  when  135°  <  T  <  180°. 
If  either  V/V  or  bank  does  not  become  zero  within  the  period  designated, 
set  Tn-  (i  =  1  or  2)  to  0. 
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Compute 


1 

m 

% 

0 

AND 

T* 

*  0 

-1  •  Tj  s 

0 

OR 

*  0 

S7  tells  us  the  elapsed  time,  in  seconds,  between  points  where  V/V  and 
bank  become  zero.  If  S-,  is  -1,  this  means  the  quantity  was  unmeasurable. 

(d)  Airspeed 

Airspeed  should  be  200  knots  on  entry,  i.e.,  at  the  0°  turn 
point,  with  a  tolerance  of  +_3  knots.  At  the  90°  and  180  turn  points, 
airspeed  should  be  100  and  200  knots  respectively,  with  a  tolerance  of 
+5  knots.  At  all  other  points  in  the  maneuver,  airspeed  must  be  more 
than  100  knots,  and  less  than  200  knots. 

Let 


MM, 


A -200  ,  A>  200  AND  2  <  T  <  178 
100 -A  ,  A  <  100  AND  2  <  T  <  178 
0  ,  otherwise 


w 


MM,  dl 


where  A  =  airspeed  in  knots. 
Then  compute 
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Sg  is  an  integrated  error  measure  showing  how  much  the  airspeed  criteria 
are  exceeded  from  2  to  178°  of  turn.  It  checks  for  deviation  below 
100  knots  or  above  200  knots. 


To  check  airspeed  at  the  0,  90,  and  180°  turn  points,  we  will  compute: 

S,  »  |A0  -  200 | 

S,o  *  |A,o-  100 1 

Su  -■  |*l»-200| 

where  =  airspeed  at  T  =  K. 

(e)  Altitude 

The  main  requirement  on  altitude  is  that  the  maximum  altitude 
attained  in  the  maneuver  (ALT^)  should  occur  at  the  90°  turn  point. 

We  can  further  hypothesize  that  altitude  should  be  the  same  at  the  0° 
turn  point  as  It  is  at  the  180°  turn  point  and  the  same  at  the  90°  turn 
point  as  it  is  at  the  270°  turn  point,  because  this  is  a  symmetrical 
maneuver.  Further,  altitude  should  be  monotonically  increasing  from 
T  =  0°  to  T  =  90°  and  monotonically  decreasing  from  T  =  90°  to  T  =  180°. 


First,  a  measure  is  needed  tu  check  that  the  maximum  altitude  is 
attained  at  the  90°  turn  point.  Also,  if  ALTmav  is  not  attained  at  the 


90°  turn  point,  we  should  record  (1) 


'MAX 
where  ALT, 


MAX 


is  attained  and 


(2)  how  much  ALT^  differs  from  the  altitude  attained  at  90°.  In 
monitoring  altitude  it  will  be  necessary  to  check  the  entire  maneuver 
from  start  to  completion  rather  than  to  check  one  half  independent  of 
the  other  half. 


Let  AA^  =  maximum  altitude  obtained  from  T  =  0°  to  T  =  360°. 
Let  ALT^  =  Altitude  obtained  at  T  =  K° 

TT,  =  Degrees  of  turn  when  AA-j  occurs. 
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Compute 

S12  " 

1  ALT1 80  ‘  ALT0 

S13  " 

1  ALT360  '  ALT0 

S14 

|  alt90  -  alt270 

S15  = 

|  AA]  -  ALT9q 

S16  = 

|  n1  -  9° 

I  How  much  does  altitude  at  turn  =  180°  differ 
from  starting  altitude? 

I  How  much  does  altitude  at  turn  =  360°  differ 
from  starting  altitude? 

j  How  much  does  altitude  at  turn  =  90°  differ 
1  from  altitude  at  turn  =  ^70°^ 


How  much  does  MAX  altitude  differ  from 
altitude  at  turn  =  90°? 


I  How  far  off  was  the  pilot  from  90°  when 
,j!AX  altitude  occurred? 


(f)  Acceleration  (g  Force) 


The  main  requirement  on  g  force  is  that  it  be  between  1  and 
2  g's  at  the  start  (T  =  0)  and  end  (T  =  360)  of  the  maneuver. 


Let 


Then  compute 


G  -  2,  G>  2  at  T  =  K 


G  ,  G  <  I  at  T  =  K 
O  ,  otherwise  at  T  =  K 


S,t  s  G0 
Sl«  =  GS«0 


This  gives  us  absolute  deviations  outside  criteria  for  g's  at  the  start 
and  end  of  the  maneuver. 


(g)  RPM 

RPM  must  be  90%  throughout  the  maneuver.  A  tolerance  of 
+U  is  specified. 
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RPM,  -  92  ,  RPMj  >  92 
AM,  =  88  -  RPM,  ,  RPM,  <  88 


0  ,  otherwise 


Compute 


*i»  *  / 


AM,  dT 


-19  —  an  integrated  error  measure  showing  how  much  the  RPM  tolerances 
were  exceeded  over  the  maneuver. 

Table  X  presents  a  summary  of  the  above  measurer,  S]  -  S19  (See  Table 
XI  for  a  definition  of  terms  used  in  the  summary  table). 

Figure  15  is  a  maneuver  diagram  for  the  lazy  8  showing  which  portions 
of  the  maneuver  are  checked  by  each  experimental  performance  measure. 
Continuous  measures,  as  depicted  in  Figure  15,  are  ones  which  monitor  one 
or  more  performance  variables  continuously  for  a  discrete  time  interval. 
Discrete  measures  monitor  certain  performance  variables  at  .selected 
discrete  points  in  the  maneuver. 

(h)  Combined  Theoretical  Measures 

For  experimental  purposes,  the  following  scaled  measures  and 
combinations  thereof  were  computed  and  printed,  in  addition  to  the 
individual  measures.  The  assigned  weights  are  based  on  the  authors' 
judgment  as  to  measure-criticality.  The  scaling  is  based  on  the 
expected  ranges  in  Table  X  and  is  designed  to  produce  combined  measures 
that  range  from  0  to  100  to  standardize  the  measures.  For  example, 

S-,  and  Sg  are  the  individual  theoretical  measures  pertaining  to  degree 
of  bank.  Their  expected  ranges  are,  for  each,  0  to  3000  (See  Table  X). 
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Estimated  number  of  data  passes  required  in  computing  the  measure 
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TABLE  XI 

DEFINITIONS  OF  TERMS  USED  IN  TABLE  X 

T  =  degree  of  turn  since  start  of  maneuver 
B  =  angle  of  bank 

M.  =  amount  by  which  bank-angle  criteria  are  exceeded 

N^  =  amount  by  which  bank-angle  tolerances  are  exceeded 

^M.  =  absolute  value  of  the  difference  between  actual  and  criterion 

pitch  angles 

1 N  =  amount  by  which  pitch  angle  tolerances  are  exceeded 

R]  =  V/V  when  T  =  0° 

R?  =  V/V  when  T  =  90° 

R3  =  V/V  when  T  =  180° 

Ri  =  error  in  direction  of  Vertical  Velocity 

T^  =  time  when  V/V  becomes  zero  at  135°  <  T  <  180° 

T^  --  time  when  bank  becomes  zero  at  135°  <  T  <  180° 

A  =  airspeed 

MM..  =  absolute  value  of  airspeed  error  at  2°  <  T  <  178° 

Ak  =  airspeed  at  T  =  K 

AA.|  =  maximum  altitude  obtained  at  0  <  T  <  360° 

TT.|  =  turn  when  AA-j  occurs 

ALT^  =  altitude  at  T  =  K 

p 

K  =  absolute  value  of  g  force  at  T  =  K 

AM^  =  RPM  error  at  ith  sampling  instant 
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Figure  15.  Lazy  8  Maneuver  Diagram 


AFHRL-TR-72-6 


The  weights  assigned  to  them  are  1  for  (which  tells  how  much  criteria 
are  exceeded)  and  3  for  S2  (which  tells  how  much  tolerances  are 
exceeded).  Therefore  S1  +  3S2  is  a  linear  weighted  combination  of  S1 
and  $2-  Since  both  are  expected  to  range  from  0  to  3000,  (S^  +  3S2) 

could  range  from  0  to  12,000.  By  dividing  +  3S2  by  120,  the  range 
would  be  from  0  to  100;  e.g.. 


O  < 


S,  +  3S2 
120 


<  100 


Since  this  is  an  error-measure  (the  higher  the  value  the  worse, 
theoretically  at  least,  the  performance),  we  can  convert  it  to  a  score 
by  substracting  it  from  100;  e.g., 


0  <  100  - 


Sl  *  3S2  < 

120 


100 


The  combined  theoretical  measures,  each  derived  as  explained  above,  are 
presented  below  for  each  of  several  measurable  characteristics  of 
performance.  They  are  referred  to  as  "scores"  because  of  the  scaling 
applied,  but  essentially  they  are  measures  of  performance  computed  by 
combining  various  individual  theoretical  measures. 


Degree-of-Bank  Score  (DBS).  Measure  of  how  well  the  pilot's  bank 
angle  compares  with  ATC  criteria  as  a  function  of  degrees  of  turn. 
(Separate  measure  for  each  half  of  maneuver.) 

S,  +  3S2 

DBS  =  >00  -  — 1 — |2Q  *- 

Pitch  Angle  Score  (PAS).  Measure  of  how  well  the  pilot's  pitch 
angle  compares  with  ATC  criteria  as  a  function  of  degrees  of  turn. 
(Separate  measures  for  each  half  of  maneuver.) 


PAS 


100- 


S3  +  3S4 
120 
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The  weights  assigned  to  them  are  1  for  (which  tells  how  much  criteria 
are  exceeded)  and  3  for  S2  (which  tells  how  much  tolerances  are 
exceeded).  Therefore  S]  +  3S2  is  a  linear  weighted  combination  of  S1 
and  S2-  Since  both  are  expected  to  range  from  0  to  3000,  (S]  +  3S2) 

could  range  from  0  to  12,000.  By  dividing  S1  +  3S2  by  120,  the  range 
would  be  from  0  to  100;  e.g.. 


O  < 


S,  ♦  3S2  < 

120 


100 


Since  this  is  an  error-measure  (the  higher  the  value  the  worse, 
theoretically  at  least,  the  performance),  we  can  convert  it  to  a  score 
by  substracting  it  from  100;  e.g.. 


0  <  100  - 


Sl  *  3S2  < 

120 


100 


The  combined  theoretical  measures,  each  derived  as  explained  abovp,  are 
presented  below  for  each  of  several  measurable  characteristics  of 
performance.  They  are  referred  to  as  "scores"  because  of  the  scaling 
applied,  but  essentially  they  are  measures  of  performance  computed  by 
combining  various  individual  theoretical-  measures. 


Degree-of-Bank  Score  (DBS).  Measure  of  how  well  the  pilot's  bank 
angle  compares  with  ATC  criteria  as  a  function  of  degrees  of  turn. 
(Separate  measure  for  each  half  of  maneuver.) 


DBS 


100  - 


S, 


+  3S2 
120 


Pitch  Angle  Score  (PAS).  Measure  of  how  well  the  pilot's  pitch 
angle  compares  with  ATC  criteria  as  a  function  of  degrees  of  turn. 
(Separate  measures  for  each  half  of  maneuver.) 


PAS 


100- 


S3  +  3S4 
120 
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Vertical  Velocity  Score  1  (VVS1). 

transitions  from  climb  to  descent,  and 
with  the  0,  90,  and  180°  turn  points, 
of  maneuver.) 


Measure  of  how  well  the  pilot's 
the  reverse,  are  synchronized 
(Separate  measures  for  each  half 


VVS1 


IOO  - 


§5  f  3Sa 
225 


Vertical  Velocity  Score  2  (VVS2).  Measure  of  how  well  the  pilot's 
transition  from  descent  to  level  flight  (momentarily)  at  the  180°  turn 
point  is  synchronized  with  his  transition  to  a  zero  bank  a^gle.  (Separate 
measures  for  each  half  of  maneuver.) 

VVS2  *  IOO  -  5.8  $7 

Airspeed  Score  (ASS).  Measure  of  how  well  the  pilot's  airspeed 
at  the  0,  90,  and  180°  turn  points  compares  with  ATC  criteria,  and  how 
well  his  airspeed  throughout  the  maneuver  remains  within  the  bounds 
specified  by  ATC.  (Separate  measures  for  each  half  of  maneuver.) 

Sa  ♦  4  (S-  ♦  Slo  SM) 

ASS  =  IOO - 8 - - 12 - W- 

8 

Altitude  Score  1  (AS1).  Measure  of  the  symmetry  of  the  pilot's 

performance  of  the  maneuver  as  judged  by  comparing  his  altitudes  at  the 
0  and  180°  turn  points,  the  0  and  360°  turn  points,  and  the  90  and  270° 
turn  points.  (One  measure  for  entire  maneuver.) 


Sia  f  Sit  +  Sit 

AS1  *  IOO  -  — 12 - r“ - 

oo 

Altitude  Score  2  (AS2).  Measure  comparing  the  maximum  altitude  in 
the  entire  maneuver  with  the  altitude  attained  at  the  90°  turn  point; 
and  comparing  the  degrees  of  turn  achieved  when  the  highest  altitude 
was  attained  with  90°.  (Separate  measures  for  each  half  of  maneuver.) 


AS2 


IOO  - 


8I5  +  8I« 
14.7 
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g  force  Score  (GFS).  Measure  of  how  well  pilot's  g  force  at  start 
and  end  of  maneuver  remained  within  bounds  specified  by  ATC.  (Cne 
measure  for  entire  maneuver.) 

GFS  =  IOO  -  5.5  (S,7  +  S|#) 

RPM  Score  (RPMS),  Measure  of  how  well  pilot  maintains  the  required 
RPM  on  both  engines  throughout  the  maneuver.  (Separate  measures  for 
each  half  of  maneuver.) 


RPMS  =  100  -  0.53  S 


19 


Total  Score.  Measure  how  well  all  of  the  criteria  are  satisfied. 

SCORE  =  — i-jj.^7  ((DBS)  +  (PAS))  +  6(AS1) 

♦  5(AS2)  +  4  (VVS1  ♦  VVS 2  *)  +  3(ASS) 


+  2  (RPMS) +  GFS 


]  (100) 


where  VVS2 


and 


TOT 


VVS2  ,  VVS2  S  100 
0  ,  VVS2  >  100 
3900  ,  VVS 2  <  100 
3500  ,  VVS  2  >  100 


Miscellaneous  Data 


1.  Time  to  complete  maneuver 

2.  Maximum  and  minimum  pitch  angles  in  each  half  of  maneuver 

3.  Maximum  altitude  and  corresponding  T 

4.  Numb^  of  data  samples  in  each  half  of  maneuver 

5.  Number  of  inflections  in  the  roll  and  pitch  curves 


6.  The  S.j  measures  averages  over  the  entire  maneuver. 
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Let  H-j  =  the  pilot's  initial  heading 

H2  =  the  heading  atfained  during  the  maneuver  which  differs  most, 
in  absolute  value,  from 

and  P-|  =  the  pilot's  largest  positive  pitch  angle. 

It  is  hypothesized  that  in  the  perfect  maneuver,  a  plot  of  heading 
versus  pitch  angle,  suitably  scaled,  should  result  in  a  perfect  circle. 
What  we  do  not  know  about  this  criterion  circle  is  its  size,  although 
we  know  it  must  pass  through  the  point  (H1 ,  0),  i.e.,  the  starting 

position  for  heading  and  pitch  angle. 

To  construct  a  projected  criterion  circle,  we  may  use  the  starting 
position  and  one  other  position.  For  one  criterion  circle,  we  select 
H-|  and  H,,.  This  assumes  that  the  pilot's  heading  is  correct  at 
(1)  the  start  of  the  maneuver  and  (2)  the  end  of  the  second  quarter 
of  the  maneuver.  The  criterion  circle  would  thus  have  its  center 
heading  at 

W  (["■♦".]  MOO  360  j 

and  would  have  a  radius  of 

|  H,  ~  c,  |  ,  |  H,  -  C,  |  <  180 

|  360  ”  H,  +  C,  ,  |  H,  -  C,  |  >180 

Let  X.j  =  sampled  heading  at  T  =  i 
Y.j  =  sampled  pitch  angle  at  T  =  i 

Then  the  criterion  circle  is 

<*|  -  C,)2  +  Y*  =  Rf  (3) 

Now,  to  construct  a  second  (alternative)  projected  criterion  circle,  we 
may  use  the  starting  position,  H-j ,  and  the  pilot's  largest  positive  pitch 
angle,  This  assumes  that  (1)  the  pilot's  heading  is  correct  at 

the  start  of  the  maneuver,  and  (2)  the  pilot's  pitch  is  correct  at  the 
end  of  the  first  quarter  of  the  maneuver. 
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This  criterion  circle  would  have  its  center  heading  at  C 2  =  B,  where 
B  is  the  heading  held  when  P]  is  recorded.  The  radius  of  the  circle 
would  be  R2  =  Pl • 

Then  the  second  criterion  circle  is 

(X,  -  C2)2  +  Y2  =  R2  (4) 

The  measure  we  want  is  the  variance  of  the  actual  flight  path  from 
each  of  the  alternative  criterion  circles: 


S.  =||R.2  ~  (*,  "  C,)*-Y 2  |  dT  (5) 

S*=/ lR*  -  (x|  ~  C2)2-  V*  |  dT  (6) 

0 


Attitude  Measure  B.  This  attitude  measure  checks  the  symmetry  of 
the  performed  maneuver.  First  we  define  the  following: 

H-|  =  initial  heading 

=  heading  when  bank  first  becomes  90° 

=  heading  when  bank  becomes  180° 

=  heading  when  bank  becomes  270° 

Hj.  =  heading  when  bank  returns  to  0° 

P.|  =  initial  pitch  angle 

P2  =  pitch  angle  when  bank  becomes  90° 

P^  =  pitch  angle  when  bank  becomes  180° 

P4  =  pitch  angle  when  bank  becomes  270° 

P^  =  pitch  angle  when  bank  returns  to  0° 
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For  perfect  symmetry  in  the  maneuver,  the  following  should  hold: 


1. 

J  H]  -  H2  |  MOD  360  =  |  H3  -  H2  |  MOD 

360 

2. 

H1  =  H5 

3. 

H2  =  H4 

4. 

P1  -  P3  '  P5  =  0 

5. 

1  P2  1  =  lP4l 

6. 

20°  <  |  H2  -  |  MOD  360  <  30° 

7. 

p2  >  Pi  v  p3  v  p4  v  p5 

8. 

p4  <  Pl  v  p2  v  p3  v  p5 

9. 

ALT  when  is  obtained  =  ALT  when  H3 

fs  attained 

10. 

I  ALT  when  H-j  is  obtained  -  MAX  ALT  | 

=  |  ALT  when  H-|  is  obtained  -  MIN  ALT  | 


The  specific  measures  to  be  taken  to  reflect  the  degree  to  which  the 
above  criteria  are  met  are  given  below: 


1. 


4. 


S3 


|  I  H1  ‘  H2  I  M0D  360  "  I  H3  ‘  H2  I  M0D  360 
(Checks  heading  symmetry  for  half  of  maneuver.) 

2.  s4  -  |H!  -  h5|  mod  360 

(Checks  heading  equality  at  start  and  end  of  maneuver.) 


H, 


h4|  MOD 


360 


'5  1  "2 

(Checks  heading  symmetry  at  90°  and  270°  Roll  points.) 


IP1  I  *  lp3l  ♦  lpsl 

(Checks  that  Pitch  =  0  when  it  should.) 


v 


V 


I  -  I  P4 


(Checks  for  pitch  symmetry.) 


6.  Se 


0,  20°  £  |H2  '  Hi  I  M0D  360  "  30° 

H2  -  H] |  MOD  360  -  20  |  ,  |  H?  -  | 

|  |  H2  -  H] |  MOD  360  -  30  |  ,  |  H2  ~  H1  | 


MOD  360  <  20° 
MOD  360  >  30° 


104 


AFHRL-TR-72-6 


(Checks  that  reference  point  is  initially  20  to  .-iQ0  o if  the.  ' 

longitudinal  axis  of  the  aircraft.’! 

7.  Sg  =  |  MAX  (P.)  -  P2  j  (i  =  1,  3,  4,  5  if  MAX  >  l>2;  else  0) 

(Checks  that  MAX  Pitch  is  achieved  at  Roll  =  90°. )  ' 

3.  S1Q  =  |  P4  -  MIN  Pi  |  (i  =  1,  2,  3,  5  if  MIN  <  P ^  else  0) 

(Checks  that  MIN  Pitch  is  achieved  at  Roll  ::  270° . ) 

9.  S,,  =  I  ALT,  -  ALT,  I  where  ALT  -  ALT  at  ih  ! 

11  l  a  b  l  a  1 

and  ALT^  ---  ALT  at  l,( 

(Checks  for  altitude  symmetry. ) 

10.  S12-  ||ALTa-ALTx|  -  |  AIT,  -  ALT,,  I  | 

where  ALT  =  MAX  ALT 

A 

and  ALT  =  MIN  ALT 
n 

(Check  for  altitude  symmetry.) 

Attitude  Measure  C.  This  attitude  measure  involves  computing  a 
projected  criterion  flight  path  based  upon  a  type  of  "1-cst  fit"  of  a 
correctly  shaped  flight  path  to  the  observed  flight  pith.  The  major 
assumption  is  that  the  starting  point  for  the  maneuver  is  accurate. 

This  is  reasonable,  since  the  pilot  selects  his  own  starting  point  in 
relation  to  his  reference  point,  or  vice  versa.  Surely,  the  true 
criterion  flight  path  is  a  circle  passing  through  the  starting  point  . 

Furthermore,  a  diameter  of  the  circle  passes  through  H,  and  is  parallel 
to  the  earth.  Figure  16  illustrates  some  of  the  possible  criterion 
flight  paths  based  on  this  information  alone.  The  idea  here  is  to 
compute  a  single  criterion  flight  path,  and  the  method  selected  for  so 
doing  is  to  minimize  the  integral  error  between  the  observed  fligh  path 
and  the  criterion.  Figure  17  illustrates  several  hypothetical  observed 
flight  paths  and  the  approximate  criterion  flight  path  that  would  be 
computed  in  each  case. 

it  ] 
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Figure  16.  Possible  Criterion  Flight  Paths  for  Barrel  Roll 
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Computed  ciH'ilon  path 
Actual  path 


Figure  17.  Criterion  vs  Actual  Flight  Faths  for  Barrel  Roll 
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Let  =  observed  heading  at  T  =  i 
Y.  =  observed  pitch  angle  at  T  =  i 
H-j  =  heading  at  start  of  maneuver 
and  R  =  radius  of  the  criterion  circle. 


Then  the  equation  of  the  criterion  circle  is: 


(xi  -[Hi  *  R])i+Y*  *  Ri 


(7) 


where  R  is  unknown  at  the  present  and  the  +  or  -  sign  in  the  first  term 
is  determined  by  whether  the  barrel  roll  is  performed  to  the  right  (+)  or 
to  the  left  (-).  (In  computing  H]  +R,  appropriate  modifications  would 
need  to  be  made  if  a  crossing  of  0°  heading  occurs,  i.e.,  use  modulo 
360°.)  Now  we  shall  expand  the  terms  in  Equation  7  and  solve  for  R  in 
terms  of  X. ,  ,  and  : 

xf  +[h,±r]2-2X1[h,±r]+y*  =  r2 

X?  +  H2  +  R2  t  2  H,  R  -2H.X.  ♦  2X.  R  +  Y.2  -  R2  =0 


±  2H|  R  ♦  2  X|  N  =  2H|  X,  -  X2  -  H2  -  Y2 

tZ  _  uZ  _  vZ 


(8) 


R 


2  H,  X|  -  Xf  -  M|  -  Yj 
2(±  H,  ?  X,) 


Now  the  integral  equation  we  wish  to  minimize  in  order  to  arrive  at  a 
value  for  R  is 


/lR 

o 


2  H,  Xj  -  Xf  -  H,2  ~  Y,2 
2(±H,  +X,) 


I  dT 
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To  do  this,  we  select 

R  = 


2H,  X,  -  X,2  -  H,2 


,  =  l  2  (±  H,  ?  X,) 


(9) 


The  measure  desired  is  the  variance  of  the  actual  flight  path  from  the 
criterion  circle,  now  fully  determined  by  the  derivation  of  R: 


su  =/  K  -  (»i  -  [Hi  *  *])*  - *1*  |  IT 


This  is  an  integrated  error  measure  of  the  deviation  between  criterion 
and  actual  flight  paths,  as  determined  by  roll  and  heading  angles. 


(b)  RPM 


RPM  must  be  maintained  at  90%  (+1%)  throughout  the  maneuver. 
A  straightforward  measure  may  be  taken: 


Let 


Mi  = 


JrPM,  -  90  j  ,  |  RPMj  -  90  |  >1 
0  ,  |  RPM.  -  90  |  <1 


where  RPM^  is  the  actual  value  of  RPM  at  T  =  i . 


Then  the  RMS  error  is 


*14 


l.i  «?'T 

i  =i 


where  n  is  the  number  of  samples  taken  in  which  M..  ?*0. 


T h is  measures  the  average  RPM  error  when  tolerances  are  exceeded. 


(c)  Airspeed 


No  definite  restrictions  are  placed  upon  airspeed  except 
during  entry  to  the  maneuver.  On  entry,  airspeed  must  be  at  least 
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200  knots  and  should  not  exceed  230  knots.  Straightforward  measures 
may  be  taken  as  follows: 


Let  T1  and  Tn  represent  the  times  at  which  entry  to  the  maneuver  is 


begun  and  completed,  respectively.  Let 


M.  =  MAX  l  AIRSP. 
i  <  i  <  n  ' 


Mo  =  MAX  |  A  IRSP 
i  <  i  <  n  1 


200 

230 


Then  compute 


S!5  “  l 


S16  " 


0  , 

AIRSP 

> 

200 

Entry 

oirspeed  deviation 

1 

under 

200  Knot*. 

M,  , 

AIRSP. 

I 

< 

200 

o  , 

AIRSR 

< 

230 

Entry 

airspeed  deviation 

i 

over 

230  knots. 

m2  , 

AIRSfj 

> 

230 

(d)  q  Force 

g-force  is  to  be  maintained  at  1  <  G  <  4  throughout  the 


maneuver.  The  measure  we  shall  take  will  reflect  the  integrated  error 
on  g  when  it  exceeds  the  bounds,  i.e.,  when  G  <  1  or  G  >4. 


w 


s,,  =  I  Dg  dT 


Where  D„ 


0  ,  I  <  G  <  4 

G  -  4  ,  G  >  4 


! ~G  ,  G  <  1 


no 


J . •~1 . . 
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(e)  Roll  Rate 

Roll  rate  is  to  be  held  constant  throughout  the  maneuver. 

A  measure  of  constancy  may  be  obtained  by  differentiating  Roll  Rate  (RR) 
with  respect  to  time.  Thus,  we  shall  compute 


=  ~ir  £  |- 

1=1 


dRR 

dT 


Measure  of  the  constancy 
of  roll  rate. 


(Note  that  the  absolute  value  of  the  derivative  is  used  to  avoid  term' 
cancel  ling.) 


Table  XII  presents  a  summary  of  the  measures  through  S^g  (See 
Table  XIII  for  a  definition  of  terms  used  in  the  summary  table.) 


(f)  Combined  Theoretical  Measures  . 

Figure  18  is  a  maneuver  diagram  for  the  barrel  roll  with 
indications  of  the  portions  of  the  maneuver  checked  by  each  experimental 
performance  measure.  The  "continuous  measures"  indicated  in  Figure  18 
are  ones  which  monitor  one  or  more  performance  variables  every  sampling 
instant  over  a  discrete  time  interval.  Other  measures  monitor 
performance  variables  at  several  discrete  positions  during  the  maneuver. 


For  experimental  purposes,  the  following  scaled  measures  and 
combinations  thereof  were  computed  and  printed  in  addition  to  the 
individual  Si  measures.  As  described  in  the  section  on  the  lazy  8,  the 
weights  were  determined  by  the  authors  based  on  the  judged  criticality 
of  individual  measures;  and  scaling  was  performed  to  produce  combined 
measures  ranging  from  0  to  100. 


Entry  Airspeed  Score  (EAS).  Measure  of  how  well  the  pilot  holds 
..he  correct  entry  airspeed  to  the  maneuver.  Failure  to  hold  at  least 
200  knots  is  weighted  more  heavily  than  failure  to  remain  below 
230  knots. 


EAS 


IOO- 


3S,5  +  S,6 
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of  quarters  (Q)  1,  2,  3,  or  4  of  the  maneuver. 

Estimated  number  of  data-passes  required  in  computing  the  measures 
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Xi 


Yi 


5 

ALT 

0 

ALT 

ALT> 

ALT. 


B 


M, 


TABLE  XIII 

DEFINITIONS  OF  TERMS  USED  IN  TABLE  XII 

radius  of  computed  criterion  circle  No.  1 
sampled  heading  at  T  =  i 

center  heading  of  computed  criterion  circle  No.  1 

sampled  pitch  at  T  =  i 

radius  of  computed  criterion  circle  No.  2 

center  heading  of  computed  criterion  circle  No.  2 

initial  heading 

heading  when  bank  becomes  90° 

heading  when  bank  becomes  180° 

heading  when  bank  becomes  270” 

heading  when  bank  returns  to  0° 

initial  pitch  angle 

pitch  angle  when  bank  becomes  90c 

pitch  angle  when  bank  becomes  180° 

pitch  angle  when  bank  becomes  270° 

pitch  angle  when  bank  returns  to  0° 

altitude  when  is  obtained 

altitude  when  is  obtained 

maximum  altitude  obtained 

minimum  altitude  obtained 

radius  of  computed  criterion  cir^e  No.  3 

RPMi  -  90  ,  I  RPM.  -  90  I  Z  I 

0  ,  I  RPMi  -  90  I  <  I 

MAX  |  AIRSP.  -  200  | 
i£i<n  1 
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TABLE  XIII  (Concluded) 
DEFINITION  OF  TERMS  USED  IN  TABLE  XII 


M-  =  MAX  |  AIRSP.  -  230  | 

i  <  i  <  n  1 

0  ,  1  <  G  <  4 

D  =  ■  G  -  4  ,  G  >  4 

9  1  -  G  ,  G  <  1 


RR^  =  roll  rate  at  ith  sampling  instant 
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Attitude  Score  1  (AST).  Measure  of  how  well  the  pilot's  flight 
path  compares  with  a  criterion  flight  path  based  on  the  assumption 
that  the  pilot's  attitude  and  position  are  optimum  at  the  start  of  the 
maneuver  and  at  the  end  of  the  second  quarter. 

si 

AS1  =  100 - — — - 

300 

Attitude  Score  2  ( AS2) .  Measure  of  how  well  the  pilot's  flight 
path  compares  with  a  criterion  flight  path  based  on  the  assumption  that 
the  pilot's  attitude  and  position  are  optimum  at  the  start  of  the 
maneuver  and  the  end  of  the  first  quarter. 

AS2  =  100  - 

Attitude  Score  3  [Heading]  (AS3H).  Measure  of  the  symmetry  of 
the  pilot's  performance  of  the  maneuver  as  judged  by  aircraft  heading 
at  various  points.  This  includes  checks  on  (a)  comparison  of 
heading  change  over  first  and  second  quarters;  (b)  comparison  of 
headings  at  start  and  end  of  maneuver;  (c)  comparison  of  headings  at 
"top"  and  "bottom"  of  maneuver;  and  (d)  the  pilot's  reference  angle 
to  the  chosen  reference  point. 


AS3H  =  100  - 


4S3  +  3S4  +  2Ss  +  Sa 
4.5 


Attitude  Score  3  Pitch  (AS3P).  Measure  of  the  symmetry  of  the 
pilot's  performance  of  the  maneuver  as  judged  by  aircraft  pitch  angle 
at  various  points.  This  includes  checks  on  (a)  zero  pitch  at  0, 

180,  and  360°  roll  points;  (b)  comparison  of  pitch  magnitudes  at 
top  and  "bottom"  of  maneuver;  (c)  whether  maximum  and  minimum  pitch 
angles  are  attained  at  the  90  and  270°  roll  points,  respectively. 


AS3P  =  100  - 


3St  +  2S9  +  2S,0 
5.1 
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Attitude  Score  3  [Altitude]  (AS3A) .  Measure  of  the  symmetry  of 


the  pilot's  performance  of  the  maneuver  as  judged  by  aircraft  altitude 
at  various  points.  This  includes  checks  on  (a)  altitude  at  0  and 
180°  roll  points  and  (b)  comparison  of  the  maximum  and  minimum  altitude 
excursion  with  respect  to  the  starting  altitude. 


AS3A 


IOO  - 


S„  +  SI2 


60 


Attitude  Score  3  [Total]  (AS3T) .  Measure  of  the  symmetry  of  the 


pilot's  performance  of  the  maneuver  as  judged  by  aircraft  heading,  pitch 
angle,  and  altitude  at  various  points.  This  is  composed  of  a  scaled 
combination  of  the  preceding  three  attitude  measures. 


AS3T  = 


AS3H  +  AS3P  +  AS3A 


RPM  Score  (RPMS).  Measure  of  how  well  the  pilot  achieves  and 


maintains  the  required  RPM  on  both  engines  throughout  the  maneuver. 

RPMS  =  100  -  10  S14 

g  Force  Score  (GFS).  Measure  reflecting  the  amount  by  which  the 


pilot  exceeds  the  g-limits  during  the  maneuver. 

100  sl7 


GFS 


100  - 


3T 


where  T  «  total  time  to  complete  maneuver  (seconds). 


Roll  Rate  Score  (RRS).  Measure  of  the  constancy  of  roll  rate 


throughout  the  maneuver. 


RRS  =  100  - 


S 

15 


Attitude  Score  4  (AS4).  Measure  of  how  well  the  pilot's  flight 


path  compares  with  a  criterion  flight  path  based  on  a  "best  fit"  of  a 
correctly  shaped  flight  path  to  the  actual  performance. 


AS4  =  100  - 


MS 


300 


118 


AFHRL-TR-72-6 

Total  Score.  Measures  how  well  all  criteria  are  met. 

SCORE  =  [ 6  ( AS4 )  +  5  ( AS3T)  +  4  (RRS) 

+  4  (ASi)  +  4  (AS2)  +  3  ( 6FS )  +  2  (EAS)  +  RPMs] 

Miscellaneous  Data: 

1.  Time  to  complete  maneuver 

2.  Center  headings  of  criterion  circles  1  and  2 

3.  Radius  of  criterion  circle  3 

«•  H1  -  H5 

5.  P,  -  P5 

b.  Software  Implementation 

(1 )  Lazy  8  Program 

A  lazy  8  measurement  program  consisting  of  an  executive 
routine  and  a  large  subroutine  was  written  in  FORTRAN  IV  and  implemented 
on  an  IBM  7094  computer.  The  executive  routine  required  approximately 
300  FORTRAN  statements  and  performed  the  following  major  functions: 

1.  Search  magnetic  tape  for  the  event  number  corresponding 
to  the  maneuver  to  be  analyzed. 

2.  Read  the  data. 

3.  Generate  basic  plotting  data. 

4.  Print  all  pertinent  data  at  intervals  of  1/2  second. 

5.  Call  the  measurement  subroutine  that  computes  the 
theoretical  measures  described  previously. 

A  listing  of  the  executive  routine  is  provided  in  Appendix  VI. 
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The  plotting  data  generated  were  for  producing  plots  of  the 
following  variables: 

1 .  Roll  vs  Pitch 

2.  Roll  and  Pitch  vs  Time 

3.  Altitude  vs  Time 

4.  Airspeed  vs  Time 

5.  Heading  vs  Time 

6.  Approximate  Ground  Track** 

7.  Cockpit  Stick  Position 

The  data  selected  for  print-out  at  two  samples  per  second  are: 

1.  Roll 

2.  Pitch 

3.  Heading 

4.  Altitude 

5.  Airspeed 

6.  Left  RPM 

7.  Right  RPM 

8.  Longitudinal  Stick  Position 

9.  Lateral  Stick  Position 

10.  Degrees  of  Turn  into  Maneuver 

11.  Approximate  Ground-Speed 

12.  Vector  for  Computing  Ground  Track  (ALTX) 

13.  Acceleration 

6This  plot  was  generated  using  heading  and  a  computed,  approximate 
groundspeed  (GS).  The  GS  was  calculated  using  simple  trigonometric 
functions  for  the  airspeed  vector  and  pitch  angle,  and  is  accurate 
only  for  no-wind,  small -angle-of-attack  conditions. 
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The  measurement  subroutine  required  about  500  FORTRAN  statements 
and  performed  the  function  of  computing  and  printing  the  theoretical 
performance  measures. 

Program  execution  required  setup  of  two  magnetic  tapes,  one  of 
which  contained  the  calibrated  flight  data  and  the  other  of  which  was 
a  scratch  tape  for  plotting-data.  Program  execution  resulted  in 
generation  of  (1)  a  plotting-tape,  (2)  data  prir.t-out,  (3)  theoretical 
measures,  and  (4)  an  estimate  of  the  time  requirement  for  the  off-line 
plotting  job.  Subsequently,  a  request  for  plotting  had  to  be 
submitted.  Plotting  time  for  each  of  the  seven  plots  averaged  10.8 
minutes,  using  a  Calcomp  magnetic  tape  plotting  system  (30-inch  drum). 

(2)  Barrel  Roll  Program 

The  barrel  roll  measurement  program  was  implemented 
analogously  to  that  for  the  lazy  8.  The  executive  routine  was  nearly 
identical,  the  major  differences  being  (1)  a  change  in  one  of  the 
plots  produced,  i.e.,  heading  vs  pitch  instead  of  roll  vs  pitch;  and 
(2)  tne  variables  were  printed  at  10  per  second  instead  of  2  per  second. 

The  measurement  subroutine  required  about  300  FORTRAN  statements. 

The  major  functions  of  the  subroutine  are  described  in  Appendix  VII. 

Program  execution  procedures  were  the  same  as  those  described  for 
the  lazy  8  program. 

(3)  Initial  Tests 

Initial  tests  were  made  by  analyzing  the  theoretical 
measurement  program  results  of  approximately  30  lazy  8  and  barrel  roll 
performances,  flown  by  both  Flight  Test  pilots  and  an  instructor  pilot. 

For  each  performance,  a  condensed  print-out  of  critical  variables,  seven 
plots,  and  the  previously  described  theoretically  based  measures  were 
generated.  This  data  was  used  in  making  a  decision  about  formal 
analysis  and  measurement  requirements  for  subsequent  data  to  be  collected 
in  the  study. 
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Appendix  VIII  illustrates  representative  print-outs  and  theoretical 
measures  from  the  lazy  8  and  barrel  roll  measurement  programs.  In  the 
illustrated  print-out  for  the  barrel  roll,  the  reader  will  note  that 
two  columns  are  devoted  to  each  of  the  angles  roll,  pitch,  and  heading. 
This  was  done  to  provide  space  for  printing  both  the  recorded  angles 
and  Euler  angles,  designed  to  be  computed  using  recorded  body-axis 
rates.  This  was  considered  desirable  to  perform  a  dual  check  on  the 
recording  of  angular  rates  and  the  recorded  angles.  Unfortunately, 
one  of  the  rate  gyros  developed  problems  during  the  study,  and  the 
Euler  angles  effort  was  abandoned  to  the  priority  of  other  matters. 

In  the  print-out,  the  columns  containing  all  zeros  were  the  ones 
intended  to  hold  Euler  angle  data. 

Figures  19  through  32  illustrate  the  set  of  plots  produced  for 
two  sample  lazy  8  performances.  For  each  set  of  plots,  indication  is 
given  thereon  of  the  subjective  rating  assigned  in-flight  to  the 
corresponding  maneuver  performance,  the  first  having  been  rated  a  high 
"Good"  and  "Fair"  for  the  second  one.  The  performing  pilot  (a  PIT 
instructor)  illustrated  typical  performances  and  provided  the  subjective 
ratings  himself  subsequent  to  flying  the  maneuver. 

Two  of  the  plots  deserve  special  comment.  The  stick-position  plot 
emulates  the  movement  of  the  control-stick  as  "viewed"  from  the  pilot’s 
position  in  the  cockpit.  The  plot  is  generated  by  graphing  lateral 
(right/left)  versus  longitudinal  (fore/aft)  stick  position.  The  roll 
versus  pitch  plot  is  overlaid  on  a  linearized  approximation  of  ATC 
criteria,  as  specified  in  the  maneuver  analysis. 

Early  in  the  flight  test  and  initial  data  analysis  phase,  it  was 
realized  that  recorded  aircraft  heading  (See  Figures  24  and  31)  would 
present  problems.  The  directional  gyro  from  which  the  recording  was 
taken  had  the  normal  precession  and  lead-lag  errors  to  be  expected  in 
an  instrument  of  its  type  and  age.  As  a  result,  true  aircraft  heading 
could,  at  best,  be  only  estimated  during  and  immediately  after  aerobatic 
maneuvers.  In  addition,  the  method  of  instrumentation  technique  for 
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Figure  27.  Roll  vs  Pitch  for  Lazy  8  (12-19-69-27/Fair) 


AFHRL-TR-72-6 


TIME  (SECONDS) 


Figure  28.  Roll  and  Pitch  vs  Time  for  Lazy  8 
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recording  aircraft  heading  (See  Section  II)  with  the  inherent  limitation 
of  the  synchro-follower  caused  erroneous  readings  in  the  0-90°  arc. 

Although  the  task-analysis  data  for  the  lazy  8  indicated  that  heading 
should  be  the  basic  measurement  reference  variable,  we  elected  to  omit 
it  from  the  list  of  measurement  variables  for  two  reasons:  (1)  the 
problems  experienced  with  its  accurate  recording,  and  the  lack  of  time 
and  money  with  which  to  correct  the  problems;  and  (2)  the  dependent 
nature  of  heading  as  a  variable.  We  postulated  that  the  variables 
roll,  pitch,  time,  and  airspeed  would  provide  performance-relevant 
data  which  is  inclusive  of  the  information  that  aircraft  heading 
provides.  (In  part,  this  was  a  rationalization  of  the  problem  at  the 
time  the  decision  was  made;  after-the-fact,  however,  it  appears  to 
have  been  a  justifiable  move  considering  the  scope  of  the  effort.) 

Appendix  IX  illustrates  nine  additional  sets  of  lazy  8  plots, 
excluding  heading  versus  time  and  the  heading-based  plot  of  ground 
track.  Again,  the  corresponding  subjective  ratings  are  indicated  on 
the  plots,  and  they  a^e  arranged  in  order  of  decreasing  skill,  as 
judged  by  the  instructor  pilot. 

The  theoretical  measures  and  plots,  such  as  those  in  Appendix  IX, 
were  used  in  making  a  number  of  the  observations  which  helped  to  form 
a  basis  for  specification  and  development  of  a  revised  measurement 
program.  No  attempt  was  made  to  thoroughly  test  the  validity  of  the 
theoretical  measures  other  than  to  correlate  them  superficially  with 
the  instructors'  subjective  ratings.  Primarily,  their  usefulness 
consisted  of  supplementing  the  plots  to  provide  a  better  descriptive 
indication  of  the  nature  of  the  performance  and  in  providing  a 
preliminary  indication  of  the  utility  of  ATC-criteri on-referenced 
measures.  The  observations  that  were  made  will  be  discussed  now 
through  reference  to  the  sample  plots  in  Appendix  IX,  numbered 
consecutively  1-45  for  aid  in  reference. 
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First  consider  the  stick  position  plot.  Selected  plots  of  stick 
position  were  annotated  by  hand  to  show  where  various  events  took  place, 
such  as  where  the  largest  pitch  angles  occurred  and  where  the  maneuver 
was  half-completed.  The  most  significant  observation  was  that  as  the 
aircraft  initially  approaches  about  40  -  50°  of  turn  in  each  half  of 
the  maneuver,  the  direction  of  movement  of  the  stick  was  reversed. 
Apparently,  this  illustrates  the  pilot's  attention  to  the  over-banking 
tendency  of  the  aircraft.  A  stick  position  plot  which  annotates  these 
points  could  be  of  value  in  basic  flying  instruction.  A  slight 
indication  of  increased  stick  movement  as  skill  degrades  was  also 
noticed.  An  example  of  this  may  be  seen  by  comparing  Plot  1  with 
Plot  41  (Appendix  IX).  This  trend  was  not  always  consistent,  however, 
and  could  easily  be  caused  by  varying  environmental  factors  in-flight. 

The  analysis  of  stick  position  resulted  in  the  decision  to  abandon 
its  further  consideration  in  this  study.  Without  scientific  evidence, 
we  propose  that  stick  position  analysis  would  be  most  applicable  in 
(a)  basic  flying  training  studies  and  (b)  take  off  and  landing 
studies.  For  documentation  and  possible  reader  interest,  several 
additional  stick  position  plots  are  presented  in  Appendix  X. 

The  roll  versus  pitch  plot  proved  to  be  the  most  singularly 
informative  plot  of  those  considered.  Consider  Plot  2  in  Appendix  IX. 
This  performance  began  to  the  left  (can  be  seen  from  the  initial  roll 
direction  in  Plot  3).  Initially,  the  pilot  pitched  up  without  rolling, 
then  completed  a  roll  to  -90°  with  relatively  little  change  in  pitch. 

He  reached  -90°  of  roll  and  began  a  decrease  in  roll  prior  to  attaining 
his  zero  pitch  position.  In  the  roll-out  of  the  first  half  of  the 
maneuver,  he  returned  to  zero  pitch  prior  to  wings  level.  In  the 
second  half,  he  attained  maximum  positive  pitch  at  roughly  30°  roll  and 
held  this  pitch  angle  while  he  continued  to  roll  through  about  70°. 

Again,  he  reached  maximum  bank  and  began  to  roll  out  prior  to  zero 
pitch.  Upon  ending  the  maneuver,  he  reached  zero  pitch  prior  to  wings 
level.  In  both  halves  of  the  maneuver,  he  pitched  up  further  than  he 
pitched  down,  which  is  contrary  to  the  ATC  criteria  as  presented  in  the 
task  analysis. 
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The  performance  represented  by  Plot  2  was  rated  low  "Excellent." 
Comparing  Plot  2  with  Plots  12,  17,  22,  27,  32,  37,  and  42  ("fair"  and 
unsatisfactory"  performances),  one  can  gain  some  immediate  insights  to 
measurement  of  the  lazy  8  maneuver.  For  example,  plot  2  exhibits 
symmetry,  about  the  same  pitch  excursions  in  each  half  of  the  maneuver, 
and  a  relatively  smooth,  continuously  changing  roll/pitch  relationship. 
All  or  some  of  these  characteristics  are  lacking  to  some  degree  in  the 
other  plots.  In  plot  32,  for  instance,  roll  is  held  relatively  constant 
at  the  MAX-rol 1  points  in  the  maneuver,  and  pitch  is  allowed  to  reduce 
from  a  MAX  plus  to  a  MAX  minus  all  at  once.  In  plot  37,  very  little 
change  in  pitch  is  exhibited  while  a  rapidly  changing  roll  is  evident. 

In  plots  12  and  17,  lack  of  symmetry  is  obvious.  In  plot  42,  uneven 
change  in  roll  with  respect  to  pitch  is  seen  at  the  end  of  the  left  half 
of  the  maneuver.  Additionally,  by  considering  the  roll -pitch  plot  and 
the  airspeed  plot  together,  it  is  possible  to  postulate  precisely  why 
(or  why  not)  the  airspeed  criteria  are  met  by  a  given  performance.  As 
will  be  discussed  later,  it  appears  likely  that  an  individual  trained  in 
interpreting  the  plots  can  accurately  discriminate  at  least  four  skill 
levels  using  only  the  roll-pitch  and  airspeed  plots. 

The  plot  of  roll  and  pitch  versus  time  provided  little  contributing 
information  relevant  to  measurement  that  could  not  be  deduced  from  other 
plots.  The  altitude  plot  was  considered  possibly  relevant  because  in 
the  better  performances  there  was  a  consistent  overall  altitude  gain 
that  was  not  observed  consistently  in  the  less  skilled  performances. 

Also,  the  reason  for  this  altitude  gain  in  correct  performance  of  the 
lazy  8  was  an  intriguing  question.  Appendices  XI  and  XII  present 
additional  roll  versus  pitch  plots  and  airspeed  plots  which  represent 
the  same  group  of  performances  shown  in  Appendix  X. 

c.  Summary  of  Theoretical  Measures  Investigation 

Theoretical  measures  were  determined  using  the  ATC  maneuver 
analyses,  in  which  criteria  and  tolerances  were  estimated  for  various 
flight  parameters.  The  measures  consisted  of  comparisons  of  flight 
data  with  these  criteria  and  tolerances. 
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Programs  were  written  to  (1)  compute  and  print  out  the  theoretical 
measures;  (2)  print  the  raw  data  itself;  and  (3)  plot  selected 
variables.  The  programs  were  run  using  a  small  amount  of  flight  test 
and  instructor  pilot  performance  data. 

Essentially,  the  theoretical  measures  investigation  was  an  initial 
"shot-in-the-dark"  using,  as  a  basis  for  trial  measurement,  the  ATC 
information  available  at  the  start  of  the  program.  For  launching  the 
study  and  bringing  to  light  both  the  operational  and  theoretical  problems 
regarding  measurement  of  the  lazy  8  and  barrel  roll,  the  investigation 
was  100%  successful.  However,  for  demonstrating  any  kind  of  validity 
of  the  theoretical  measures  (and,  thus,  encouraging  the  investigators  at 
that  time),  the  results  may  be  considered  disastrous. 

A  serious  problem  occurred  that  was  not  originally  anticipated  with 
regard  to  the  use  of  aircraft  heading  as  a  primary  reference  variable. 

Due  in  part  to  instrumentation  problems,  and  due  in  remainder  to  the 
lead/lag  characteristics  of  the  heading  gyro  from  which  the  recording 
was  taken,  heading  itself  was  unreliable.  Therefore,  any  measure 
which  relied  on  heading  as  a  reference  was  unreliable. 

From  the  data  plotted  in  the  theoretical  measures  investigation,  it 
was  possible  to  discern  a  number  of  questionable  characteristics  of  the 
ATC  criteria  that  were  applied.  A  prime  example  is  the  criterion  that 
maximum  and  minimum  pitch  angles  be  equal  in  magnitude.  Other  criteria 
appeared  to  be  valid  and  to  represent  a  sound  basis  for  measurement,  e.g. 
the  "circle"  measures  for  the  roll/pitch  relationship  in  the  barrel  roll. 

Based  on  observations  such  as  these,  it  was  concluded  that  textbook 
criteria  very  definitely  cannot  be  assumed  to  represent  an  adequate  basis 
for  quantitative  measurement,  although  it  may  provide  initial  guidelines 
Rather  than  pursue  this  avenue  further,  (i.e.,  attempt  to  legitimately 
validate  or  disprove  the  original  set  of  ATC  criteria),  the  decision  was 
made  to  formulate  a  new  set  of  measures.  This  new  set  was  based  not  on 
ATC  criteria,  but  on  (1)  a  logical  analysis  of  that  criteria  made 
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possible  through  the  initial  application;  and  (2)  insights  into  the 
performance  of  the  maneuvers  gained  through  examination  of  actual  data. 

The  new  set  of  measures  and  other  related  program  outputs  considered 
necessary  to  conduct  the  study  constitute  the  measurement  system 
ultimately  applied  to  a  broad  spectrum  of  student  and  instructor  data. 

This  measurement  system  is  described  next. 

4.  MEASUREMENT  SYSTEM 

This  subsection  describes  the  measurement  system  designed  for 
analyzing  performance  and  computing  measures  for  a  broad  spectrum  of 
student  and  instructor  lazy  8's  and  barrel  rolls.  Prior  to  the 
specification  of  this  system  and  the  associated  measures,  an  investigation 
was  made  of  a  set  of  theoretical  measures  based  solely  upon  ATC  criteria. 
As  discussed  in  the  preceding  summary,  this  investigation  laid  the 
groundwork  for  identification  of  the  measures  and  other  desirable 
program-outputs  to  be  described  below.  To  differentiate  the  measures 
to  be  described  below  from  the  theoretical  measures  previously  discussed, 
the  new  ones  will  be  referred  to  as  experimental  measures.  (This  name 
also  attests  to  the  fact  that  the  new  set  of  measures  is  experimental 
in  nature.)  The  measurement  system  consisted  of  separate  programs  for 
the  lazy  8  and  barrel  roll  which  (1)  computed  experimental  measures, 

(2)  plotted  key  performance  variables,  and  (3)  produced  a  summary 
print-out  of  measurement-relevant  raw  data.  In  addition,  initiating 
programs  were  developed  to  record  significant  data  on  cards  for  each 
maneuver,  which  was  then  used  as  input  to  the  actual  measurement 
programs. 

a.  Punched  Card  Records  of  Maneuvers 

Considerable  difficulty  was  encountered  in  locating  and  reading 
maneuver  data  on  magnetic  tape.  This  difficulty  was  attributed  to  three 
factors:  (1)  the  magnetic  tapes  were  not  new,  (2)  the  identifying 
event  numbers  for  the  maneuvers  were  often  not  recorded  correctly  on  the 
tape  due  to  instrument  errors,  and  (3)  the  data  typically  contained 
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"glitches"  apparently  caused  by  intermittent  noise  on  the  recording 
channels.  Because  the  data  would  require  more  than  one  "pass"  for 
analysis,  and  because  it  was  to  be  retained  for  other  future  studies, 
it  was  necessary  to  "deglitch"  the  data  and  store  it  on  punched  cards. 
The  variables  to  be  thus  recorded  were  selected  on  the  basis  of  their 
expected  usefulness  in  measurement  of  performance. 


The  variables  selected  for  storage  on  cards  were  as  follows  (shown 
in  the  order  punched): 


Lazy  8 

Barrel  Roll  and  Other  Mam 

Roll 

Roll 

Pitch 

Pitch 

Heading 

Heading 

Altitude 

Altitude 

Airspeed 

Airspeed 

Normal  Acceleration 

(AT  =  0.5  secs) 

(AT  =  0.4  secs) 

The  program  which  accomplished  the  punching  and  which,  additionally, 
printed  out  selected  variables  is  listed  in  Appendix  XIII.  For  the 
lazy  8,  1.5  seconds  of  data  could  be  represented  on  each  punched  card, 

resulting  in  approximately  40  or  50  cards  per  performance.  For  the 
barrel  roll  (and  all  other  maneuvers),  one  card  represented  .8  seconds 
of  data,  resulting  in  about  40  cards  per  performance  of  the  barrel  roll. 


In  addition  to  the  recorded  data,  cards  were  punched  to  document  the 
month,  day,  year,  and  event-number  of  the  maneuver,  the  total  number  of 
data  points  punched,  the  subjective  rating  provided  for  the  maneuver, 
and,  when  applicable,  the  direction  in  which  the  maneuver  was  performed. 
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Data  "deglitching11  was  accomplished  partly  by  the  program  and  partly 
by  hand.  The  program,  prior  to  punching,  checked  for  obvious  recording 
errors  (e.g.,  variables  out  of  range)  and  corrected  the  data  at  that 
point  by  setting  it  equal  to  the  preceding  values.  Hand  analysis  was 
then  required  to  remove  "glitches"  overlooked  by  the  program  and, 
when  necessary,  smooth  out  the  step-function  effect  sometimes  resulting 
from  corrective  action  of  the  program  over  a  loncer-than-ordinary  time 
interval.  This  process  worked  satisfactorily  but  was  extremely  time 
consuming. 

The  format  in  which  the  cards  were  punched  is  as  follows: 

Card  1:  Month,  Day,  Year,  Event  Number  3I5,F7.0 

Card  2:  Number  of  recorded  points  15 

Card  3:  Rating,  Direction  215 

Remaining  Cards:  Data  for  lazy  8  3^F7"o,F5'o),:^,0, 

Data  for  barrel  roll  and  others  2(F5.0,!:4.0,F5.0, 

F7.0.F5.0.F5.1) 


b.  lazy  8  Experimental  Measures 

Following  is  a  description  of  forty-one  measures  designed  to  be 
computed  for  each  performance  of  the  lazy  8  maneuver: 


(1)  MAX1  -  Maximum  positive  pitch  in  first  half  of  maneuver 

(2)  MIN1  -  Minimum  pitch  in  first  half  of  maneuver 

(3)  MAX 2  -  Maximum  pitch  in  second  half  of  maneuver 

(4)  MIN2  -  Minimum  pitch  in  second  half  of  maneuver 

Roll,  airspeed,  and  altitude 
change  [since  start  of  maneuver] 
at  points  of  MAX,,  MIN,,  MAX2, 
and  MIN2. 

(17)  MAX  +  ROLL  -  Maximum  positive  roll 
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(9-12) 

ARSP.  1 

(i  =  1,4) 

(13-16) 

ALTX. 

(i  =  1,4) 
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(18)  MAX  -  ROLL  -  Maximum  negative  roll 

(19)  Time  Half  1 

-  Time  (seconds)  required  to  perform 

(20)  Time  Half  2  each  half  of  the  maneuver. 

(21)  Total  Time  -  Total  maneuver  time 

(22)  E.|  -  Starting  airspeed  minus  200 

(23)  -  First  minimum  airspeed  minus  100 

(24)  E^  -  MAX  airspeed  at  middle  of  maneuver  minus  200 

(25)  E^  -  Second  minimum  airspeed  minus  100 

(26)  Eg  -  Ending  airspeed  minus  200 

(27)  E6  =  l  |  E,  | 

i  =  1 


(28)  E7 


(29) 


E8  = 


i  Mil 

i  =  1 

*  Mil 

i  =  3 


(30)  Eg 

(31)  E1q 

(32)  En 

(33)  E-J2 

(34)  E13 

(35)  E14 

(36)  E15 
(27)  E16 

(38)  T1 

(39)  T2 


Absolute  value  of  the  airspeed- 
change  between  the  five  local 
maxima  and  minima  (e.g.,  Eg  = 
abs.  val .  of  difference  between 
starting  airspeed  and  first  local 
minimum  airspeed). 


iChange  in  airspeed  I  divided  by 

change  in  time  over  the  four 

intervals  of  the  maneuver 

referenced  above  by  EQ  through 

F  y 

l12* 


Time  (seconds)  during  intervals 
referenced  above  by  Eg  through 

E12  anc!  E-|3  through  E^. 
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(40)  T3 

(4D  T4  ' 

In  addition,  measures  of  roll,  airspeed,  and  altitude  excursion 
are  computed  at  specified  points  throughout  the  maneuver.  The  points 
are  composed  of  all  local  maximum  and  minimum  pitch  values  plus 
intermediate  points  at  multiples  of  1/3  times  the  local  extrema. 

The  measures  program  produces  for  each  performance  of  the  lazy  8, 

(1)  a  print-out  of  roll,  pitch,  heading,  altitude,  and  airspeed  at 
AT  =  0.5;  and  (2)  the  experimental  measures.  In  addition,  the 
program  computes  means  and  standard  deviations  of  all  measures  for  selected 
groups  of  performances.  Sample  output  is  shown  in  Appendix  XIV. 

c.  Barrel  Roll  Experimental  Measures 

Following  is  a  description  of  thirty-six  measures  designed  to 
be  computed  for  each  performance  of  the  barrel  roll  maneuver. 

(1)  Symmetry  Measures 

Let  X.  =  pitch  values  sampled  at  I  roll  I  =10°,  20°,  . . 

1  '  180°,  170° . 

10°. 


(i  =  1,  35) 
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(2)  Roll/Pitch  Circle  Measures 

Let  Roll i  and  Pitchi  (i  =  1,  71)  be  the  sampled  roll  values 
and  corresponding  pitch  angles  at  Roll  =  5°,  10°,  180  ,  175  , 

.....  5°. 

Let 

X,  =  |  ROLL,  | -90 

90  (PITCH,) 

V|  '  1  P'TCH^ax  I 

where  PitchMAX  =  maximum  absolute  value  of  all  Pitchy 


-  90] 


m4  = 

1 

'.W 

At 

*5  * 

1 

TT 

J  l  *.* 

V  1  =36 

/n 

M,  * 

i 

7T 

J  i z* 

l=i 

Comport*  roll  and  pitch  with 
clrclo  crlttrlon  ovr  holt  1 

Comport*  roll  owd  pitch  with 
clrclt  crlttrlon  ovtr  holt  Z 

Comport*  roll  ond  pitch  with 
circlt  crlttrlon  ovtr  montuvtr 


(3)  Constancy  -  Measures  on  Rates  and  g 1 s 

These  measures  check  the  constancy  of  roll  rate,  pitch  rate, 
and  g's  by  computing  regression  coefficients  and  correlation. 

Let  Roll.,  Pitch..,  and  G.  be  the  values  of  roll  (arranged  to  go 
from  0  to  360°),  pitch,  and  g's  at  time- increments  of  0.4  seconds 
(i  =  l,  K).  Using  a  5-point  Lagrange  formula,  compute: 


=  roll  rate 
Y2i  =  pitch  rate 
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Let  M  be  the  value  of  i  at  the  point  where  Roll,  first  becomes  £  45°, 
and  let  N  be  the  value  of  i  at  the  point  where  Roll.,  last  is  >  4*5°. 

Set  j  =  1  at  i  =  M,  and  j  =  K  =  N-M+l  at  i=N.  Compute  M. ,  for  i  =  16, 
24  by  replacing  i  with  j  in  the  foregoinq  analysis.  Then  M,,  to 

— - 15 -  24 

are  the  same  measures  as  M,  to  M] 5  over  the  interval  I  Roll  I  >  45. 


(4)  Miscellaneous  Measures 


(1) 

M25 

(2) 

M26 

(3) 

M27 

(4) 

M28 

(5) 

M29 

(6) 

M30 

(7) 

M31 

(8) 

m32 

(9) 

M33 

(10) 

M34 

(ID 

M35 

(12) 

M36 

MAX.  and  MIN.  pitch  rate 


Time  for  first  and  second  halves 


In  addition,  measures  of  pitch,  roll  rate,  pitch  rate,  roll-pitch 
"error"  (based  on  circle  criterion) ,  heading  excursion,  altitude 
excursion,  and  airspeed  excursion  are  computed  for  every  10°  of  roll. 


The  measures  program  produces,  for  each  performance  of  the  barrel 
roll  (1)  a  printout  of  roll,  pitch,  heading,  altitude,  airspeed, 
and  g's  at  AT  =  0.4;  and  (2)  all  experimental  measures  described 
above.  Sample  output  is  shown  in  Appendix  XV. 


"i  — 
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d.  Debriefing  Plots 

A  debriefing  plot,  as  the  term  is  used  in  this  study,  is  a  graph 
of  one  or  more  flight  variables  which,  when  supplemented  by  selected 
performance  measures,  assists  one  in  evaluating  the  performance 
diagnostically.  Through  a  select  combination  of  debriefing  plots  and 
measures,  the  authors'  intent  was  to  show  that  performance  can  be 
evaluated  after-the-fact  more  diagnostically  and  with  better  skill 
discrimination  than  is  possible  (or  at  least  feasible)  in-flight. 

Three  such  plots  were  developed  for  the  lazy  8: 

1.  Airspeed  vs  time 

2.  Pitch  vs  roll 

3.  Altitude  vs  time 

In  addition  to  generating  the  plots  themselves,  computer  programs 
also  annotated  each  plot  with  measurement-relevant  information.  For 
example,  the  airspeed  plot  was  designed  to  include  the  location  and 
value  of  local  maximum  and  minimum  pitch  values. 

Examples  of  these  plots  for  four  laxy  8  performances  are  presented 
in  Appendix  XVI.  In  addition  to  the  computer  generated  graphs  and 
annotations,  additional  comments  are  included  on  the  plots  to 
(1)  explain  the  annotations  and  (2)  point  out  some  highlights 
illustrating  the  type  of  diagnostic  information  contained  in  the  plots. 

Eight  debriefing  plots  were  designed  for  the  barrel  roll: 

1.  Roll,  pitch,  airspeed,  and  altitude  vs  time 

2.  Heading  vs  time 

3.  g's  vs  time 

4.  | Rol 1 1  vs  Pitch 

5.  Rol 1 /Pi tch  Polar  Plot 

Q  =  Roll 
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R  =  |  Pitch  | 

Plot  X  =  R  cos  8  vs  Y  =  R  sin  8 

6.  Pitch  vs  Roll 

7.  Altitude  vs  Roll 

8.  g's  vs  Roll 

Examples  of  these  plots  for  two  performances  of  the  barrel  roll  are 
illustrated  in  Appendix  XVII. 

e.  Summary  of  Experimental  Measures 

Section  VIII  of  this  report  discusses  the  results  of  applying 
the  experimental  measures  to  a  broad  selection  of  student  and  instructor 
performances.  For  convenience  in  reference,  the  experimental  measures 


are 

summarized  below: 

(1)  Lazy  8 

No. 

Units 

Experimental 

Measures 

1 

Deg 

Max.  (positive)  pitch 

in  half  1 

(max. 

1) 

2 

Deg 

Min.  ’negative)  pitch 

in  half  1 

(min. 

D 

3 

Deg 

Max.  (positive)  pitch 

in  half  2 

(max. 

2) 

4 

Deg 

Min.  (negative)  pitch 

in  half  2 

(min. 

2) 

5 

Deg 

Roll  at  max.  1 

6 

Deg 

Roll  at  min.  1 

7 

Deg 

Roll  at  max.  2 

8 

Deg 

Roll  at  min.  2 

9 

Kt 

Airspeed  at  max.  1 

10 

Kt 

Airspeed  at  min.  1 

11 

Kt 

Airspeed  at  max.  2 

12 

Kt 

Airspeed  at  min.  2 
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No. 

Units 

Experimental  Measures 

13 

Ft 

Altitude  excursion  at  max.  1 

14 

Ft 

Altitude  excursion  at  min.  1 

15 

Ft 

Altitude  excursion  at  max.  2 

16 

Ft 

Altitude  excursion  at  min.  2 

17 

Deg 

Max.  positive  roll 

18 

Deg 

Max.  negative  roll 

19 

Sec 

Time  to  perform  half  1 

20 

Sec 

Time  to  perform  half  2 

21 

Sec 

Total  time  for  maneuver 

22 

Kt 

Start  airspeed  -  200 

23 

Kt 

1st  min.  airspeed  -  100 

24 

Kt 

Max.  ail  speed,  end  1st  half,  -  200 

25 

Kt 

2nd  min,  airspeed  -  100 

26 

Kt 

End  airspeed  -  200 

27 

Kt 

Sum  of  measures  22-26  (all  maneuver) 

28 

Kt 

Sum  of  measures  22-24  (half  1) 

29 

Kt 

Sum  of  measures  24-26  (half  2) 

30 

Kt 

Airspeed  excursion  1st  quarter 

31 

Kt 

Airspeed  excursion  2nd  quarter 

32 

Kt 

Airspeed  excursion  3rd  quarter 

33 

Kt 

Airspeed  excursion  4th  quarter 

34 

Kt/Sec 

Rate  of  change  of  airspeed  1st  quarter 

35 

Kt/Sec 

Rate  of  change  of  airspeed  2nd  quarter 

36 

Kt/Sec 

Rate  of  change  of  airspeed  3rd  quarter 

37 

Kt/Sec 

Rate  of  change  of  airspeed  4th  quarter 

38 

Sec 

Time  1st  quarter 
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No. 


Units 


Experimental  Measures 


39 

Sec 

Time  2nd  quarter 

40 

Sec 

Time  3rd  quarter 

41 

Sec 

Time  4th  quarter 

(2)  Barrel  Roll 

No. 

Units 

Experimental  Measures 

1 

Non-Dim. 

Symmetry  between  quarters  1  and  4 

2 

Non-Dim. 

Symmetry  between  quarters  2  and  3 

3 

Non-Dim. 

Symmetry  between  halves  1  and  2 

4 

Non-Dim. 

Comparison  with  circle  -  half  1 

5 

Non-Dim. 

Comparison  with  circle  -  half  2 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16-24 

25 

26 

27 

28 


1.  i 

-1 


Non-Dim. 
Non-Dim. 
Non-Dim. 
Non-Dim 
Non-Dim.  1 
Non-Dim 
Non-Dim. 
Non-Dim 
Non-Dim 
Non-Dim. 
Non-Dim. 

9 


:) 


Comparison  with  circle  -  maneuver 
Roll  rate  regression  coefficients 
Correlation:  roll  vs  roll  rate 
Pitch  rate  regression  coefficients 
Correlation:  roll  vs  pitch  rate 
Normal  acceleration  regression  coefs. 


9 

9 

Deg 


Correlation:  roll  vs  normal  acceleration 

Same  as  7-15,  but  for  |Roll|  2  45° 

Max.  g  half  1 

Max.  g  half  2 

Min.  g  whole  maneuver 

Roll  at  max.  positive  pitch 
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No. 

Units 

Experimental  Measures 

29 

Deg 

Roll  at  max.  negative  pitch 

30 

Deg/Sec 

Max.  roll  rate 

31 

Deg/Sec 

Min.  roll  rate 

32 

Deg/Sec 

Max.  pitch  rate 

33 

Deg/Sec 

Min.  pitch  rate 

34 

Sec 

Total  time  for  maneuver 

35 

Sec 

Time  half  1 

36 

Sec 

Time  half  2 
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SECTION  VI 

FLIGHT  TESTING  AND  DATA  COLLECTION 


The  calibration  of  the  data  acquisition  system  was  conducted 
principally  at  Wrlght-Patterson  AFB,  whereas  the  data  collection  flights 
on  maneuver  performance  were  accomplished  predominantly  at  Williams  AFB. 
Specifically,  a  total  of  40  calibration  flights  and  51  maneuver  data 
collection  flights  were  conducted  throughout  the  program.  However,  17 
of  the  flights  flown  in  support  of  the  Pilot  Performance  Measurement 
Program  resulted  in  no  useful  data  being  obtained  due  to  system 
malfunction  or  weather.  The  total  flying  time  on  948  was  114.7  hours 
over  91  sorties. 

Maintenance  support  for  the  aircraft  and  data  acquisition  system 
was  provided  by  Flight  Test  at  Wrlght-Patterson  AFB  and  by  Air  Training 
Command  technicians  assigned  to  the  Directorate  of  Maintenance  at 
Williams  AFB.  Pilots  from  the  Fighter  Test  Squadron  and  AFHRL  research 
psychologists  flew  the  calibration  flights.  All  of  the  UPT  student 
data  collection  flights  were  flown  at  Williams  AFB  with  one  of  the  AFHRL 
instructor  pilots. 

1.  OPERATING  PROCEDURES 

The  procedures  discussed  in  this  section  have  evolved  from 
operational  experience  with  the  data  acquisition  system  and  resulted 
in  the  development  of  the  most  efficient  method  of  recording  calibration 
and  maneuver  data,  within  specific  restrictions,  for  pilot  performance 
measurement  research. 

a.  Tape  Handling 

Prior  to  each  flight,  the  one  inch  mag  tape  was  Installed  in 
the  Leach  tape  recorder  according  to  the  following  procedures: 

1.  Check  that  all  cockpit  switches  on  the  Recorder  Control 
Panel  are  in  the  OFF  position. 
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2.  Apply  28  VDC  ground  power  to  the  aircraft. 

3.  Turn  the  recording  system  MASTER  SW  to  the  ON  position 
on  the  cockpit  Recorder  Control  Panel. 

4.  Raise  the  guard  on  the  GROUND  TO  FLIGHT  switch  and  move 
this  switch  to  the  GROUND  position. 

5.  Turn  the  TAPE  RECORDER  POWER  switch  to  the  ON  position. 

6.  Remove  the  cover  on  the  Leach  tape  recorder  located  in  the 
lower  fuselage  bay  area. 

7.  Check  that  the  recorder  POWER  switch  is  in  the  ON  position 
(When  power  is  on,  the  STOP  button  will  be  RED). 

8.  Load  the  mag  tape  on  the  recorder  with  the  supply  reel  on 
the  right  and  take  up  reel  on  the  left. 

9.  Actuate  the  FAST  FORWARD  switch  and  allow  the  tape  to  run 
for  five  seconds  before  activating  the  STOP  button. 

10.  Place  cover  on  tape  recorder. 

11.  Return  the  TAPE  RECORDER  POWER  switch  to  OFF  position  on 
cockpit  Recorder  Control  Panel. 

12.  Return  the  GROUND  TO  FLIGHT  switch  to  ON  position  (guard 

down) . 

13.  Return  COUNTER  to  zero. 

14.  Return  MASTER  SW  to  OFF  position. 

Subsequent  to  the  flight,  the  tape  was  down-loaded  and  transported 
to  the  Data  Reduction  Branch  of  Flight  Test.  At  Williams,  the  tapes 
were  boxed  and  shipped  via  commercial  air  the  same  day  of  the  flight. 

It  became  imperative  to  reduce  the  tape  and  print-out  the  data  as  quickly 
as  possible  in  order  to  ascertain  if  all  the  parameter  sensor  systems 
and  the  tape  recorder  were  operating  properly.  A  minimum  of  three  days 
was  normally  required  between  the  student  data  flight  at  Williams  AFB 
and  a  check  of  the  data  that  was  performed  by  the  authors  at  Wright- 
Patterson. 
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b.  Recorder  Operating  Procedures 

Upon  taxiing  to  the  number  one  position  for  takeoff,  the  data 
acquisition  system  was  turned  to  a  standby  mode  and  an  automatic 
calibration  cycle  initiated  as  follows: 

1 .  MASTER  SW  -  ON 

2.  INVERTER  switch  -  ON,  red  light  out 

3.  PCM/DAS  switch  -  ON 

4.  RECORDER  POWER  switch  -  ON, 

(TAPE  OFF  amber  light  on) 

5.  Check  GROUND  TO  FLIGHT  switch  -  ON 

(guard  down),  green  light  on 

6.  TIME  CODE  switch  -  ON 

7.  RECORDER  CONTROL  switch  -  ON 

8.  Complete  equipment  calibration  check; 

(rapid  sequence) 

a.  Change  record  number 

b.  Depress  AUTO  CAL  button 

c.  Change  record  number 

9.  RECORDER  CONTROL  switch  -  OFF 

After  flying  under  radar  control  to  the  designated  area  where  the 
calibration  tests  or  maneuvers  were  to  be  performed,  the  instructor 
pilot  commenced  the  data  collection  by  turning  the  RECORDER  CONTROL 
switch  to  the  ON  position  and  changing  the  record  number  by  depressing 
the  RECORD  NO.  button.  The  record  number  was  changed  at  the  beginning 
and  end  of  each  maneuver  in  order  to  facilitate  the  visual  examination 
of  the  data  print-out  and  provide  discrete  events  for  computer  data 
processing.  The  recorder  was  turned  off  during  extended  periods  of 
time  when  data  was  not  being  scored,  such  as  climb  and  descent.  By 
employing  this  method  of  tape  conservation,  the  60  minute  mag  tape 
was  of  sufficient  duration  to  record  in  excess  of  the  average  mission 
flying  time  of  1.3  hours. 
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Frequently  the  audio  tape  recorder  was  utilized  on  the  mission. 

It  proved  to  be  an  effective  method  for  obtaining  the  instructor  pilot's 
comments  and  critique  of  the  student's  performance  narrative  account  of 
a  maneuver  being  demonstrated  by  the  IP,  weather  information,  system 
malfunctions,  and  other  qualitative  data  pertinent  to  describing  the 
quantitative  recording  of  performance. 

2.  CALIBRATION  PROCEDURES 

Precise  procedures  were  established  for  the  calibration  of  the 
flight  and  engine  parameters  with  the  corresponding  cockpit  instrument. 
The  flight  crew  was  briefed  on  the  parameters  and  method  of  calibration 
prior  to  each  flight.  A  Test  Data  Card  was  used  to  indicate  the 
parameters  to  be  calibrated  and  the  value  and  record  number  of  each  data 
point.  Additional  information  that  was  written  on  the  Test  Data  Card 
included: 

1.  Aircraft  type  and  number  (T-37B/948) 

2.  Flight  test  project  number  (7184/604) 

3.  Date 

4.  Flight  .lumber 

5.  Pilot 

6.  Data  recorder 

7.  Takeoff  time 

8.  Landing  time 

9.  Mission  duration 

10.  Current  altimeter  setting 

Auto  calibration  record  number 


11. 
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The  basic  parameter  calibration  procedures  were  provided  to  the 
flight  crew  in  the  form  of  a  checklist: 

1.  Set  current  altimeter  setting  in  left  altimeter  and  record 
setting  on  Test  Data  Card. 

2.  Prior  to  recording  any  calibration  data,  depress  the  AUTO 
CAL.  button  for  one  second  with  the  recorder  on. 

3.  Turn  recorder  on  for  the  entire  period  that  one  parameter  is 
being  calibrated,  so  that  data  will  reflect  transition  from  one  step  to 
another. 


4.  Obtain  a  minimum  of  5  seconds'  scoring  for  each  incremental 
step  after  the  parameter  is  stabilized  at  the  desired  value. 

5.  Upon  stabilizing  at  a  new  parameter  step,  depress  RECORD  NO. 
button  to  advance  the  counter,  which  signals  the  beginning  of  a  5-second* 
scoring  period. 

6.  Write  counter  reading  on  Test  Data  Card  for  each  parameter 

step. 


7.  Complete  the  scoring  in  succession  when  two  steps  are 
designated  by  a  bracket. 

8.  Any  deviations  from  normal  calibration  procedures  should  be 
noted  on  the  data  card  or  audio  tape  recorder. 

Checklist  item  number  7  refers  to  a  procedure  used  during  the  calibration 
of  a  parameter  of  reversing  the  established  trend  to  determine  if  the 
resolution  of  the  sensor  system  would  be  able  to  identify  a  small  change 
in  the  opposite  direction.  Another  technique  used  was  to  calibrate  the 
parameter  entirely  in  one  direction  (e.g.,  increasing  airspeed)  and 
then  repeat  the  same  data  points  but  proceeding  in  the  opposite  direction 
(e.g.,  decreasing  airspeed).  Thus,  two  recorded  data  points  could  be 
compared  for  the  same  parameter  value  so  that  an  assessment  could  be 
made  of  the  reliability  of  the  sensor  system. 
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Table  XIV  indicates  those  parameters  that  were  able  to  be  calibrated 
in-flight,  the  range  over  which  the  calibration  occurred,  incremental 
steps  established,  and  the  magnitude  of  the  reversal  interjected  in  the 
general  trend  of  the  parameter. 

3.  MANEUVER  DATA  COLLECTION  PROCEDURES 

Flights  conducted  to  gather  maneuver  performance  data  from  instructor 
pilots  and  UPT  students  utilized  the  same  operational  procedures 
previously  described  in  this  section,  plus  several  additional  procedures. 

The  AFHRL  instructor  pilots  provided  descriptive  information 
regarding  the  student  on  the  Test  Data  Card  as  follows: 

1.  ATC  Syllabus  Instructional  Unit  flown  (Sorties  were  all 
from  the  Contact,  Dual,  Advanced  Maneuvers  Instructional  Units). 

2.  Number  of  last  Contact,  Advanced  Maneuver  Instructional  Unit 
Flown,  including  date  of  flight,  and  whether  flight  was  dual  or  solo. 

3.  Total  hours  of  T-37  flying  time  accumulated  by  the  student 

to  date. 


4.  Prevailing  weather:  ceiling,  visibility,  turbulence. 

5.  Instructor  comments  on  capability  of  student  with  respect  to 
the  class  norm  at  that  stage  of  training  (e.g.,  low  average,  outstanding, 
solid  and  smooth  student). 

6.  Mid-phase  (contact)  check  ride  grade. 

7.  Coded  description  of  the  maneuver  performed  such  as  L-8-L, 
a  lazy-8  initiated  to  the  left;  B-R-R,  a  barrel  roll  to  the  right; 

PATT-L,  a  normal  360°  overhead  traffic  pattern  with  a  left  break. 

Instructor's  grade  on  each  maneuver  performed  by  a  student, 
another  instructor  pilot,  or  a  maneuver  demonstrated  by  the  AFHRL  IP. 
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The  rating  system  employed  on  the  maneuver  data  collection  flights 
was  the  standard  ATC  rating  scale.  This  is  an  absolute  rating  scale 
whereby  the  student's  performance  is  judged  against  the  perfectly  flown 
maneuver  whether  he  is  an  experienced  instructor  or  a  neophyte  student 
pilot.  No  consideration  is  given  to  the  type  or  amount  of  training  the 
student  has  received.  The  categories  of  the  rating  scale  are: 

Excellent  (£)  -  The  student  performed  the  maneuver  correctly, 
quickly,  and  efficiently. 

Good  (G)  -  The  student  performed  the  maneuver  with  little  hesitation 
and  no  assistance. 

Fair  (F)  -  The  student  performed  the  maneuver,  but  made  some  false 
starts,  repetitions,  or  minor  errors  of  omission  or  commission. 

Unable  to  Accomplish  (U)1  -  The  student  lacked  sufficient  knowledge, 
skill,  or  ability  to  perform  the  maneuver  without  assistance. 

Another  procedure  instituted  for  the  maneuver  data  collection  flights 
was  a  brief  calibration  of  several  parameters  during  the  climb  or 
immediately  after  level  off.  The  purpose  of  this  calibration  procedure 
was  to  ascertain,  on  a  regular  basis,  that  the  more  important  sensor 
systems  and  magnetic  tape  recorder  were  operating  properly.  The 
instructor  recorded  a  single  data  point  and  record  number  on  the  Test 
Data  Card  while  the  student  flew  the  aircraft  in  a  steady-state  condition 
on  the  following  parameters: 


1. 

Heading 

2. 

Altitude 

3. 

Airspeed 

4. 

Pitch  Angle 

5. 

Roll  Angle 

^Sometimes  referred  to  in  the  report  as  unsatisfactory. 
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6.  g  Force 

7.  RPM 


Immediately  upon  receipt  of  the  computer  print-out  from  these 
maneuver  data  flights,  the  authors  would  visually  examine  each  of  these 
seven  parameters  at  the  specific  record  numbers  indicated  on  the  Test 
Data  Card.  A  comparison  was  made  of  the  recorded  data  point  and  the 
instrument  reading  to  determine  if  the  data  point  fell  within  the  normal 
resolution  capability  for  that  parameter.  Also,  a  flight-by-flight  plot 
of  each  parameter  was  accomplished  to  provide  trend  information  on  the 
reliability  of  the  parameter  sensor  system.  If  any  malfunction  was 
revealed  in  the  data  acquisition  system  during  these  cursory  calibration 
checks,  the  data  collection  flights  were  temporarily  suspended  until 
the  equipment  problem  had  been  analyzed  and  corrected  by  the 
instrumentation  technicians.  The  infrequent  system  malfunctions 
usually  required  tne  magnetic  tape  recorder  head  to  be  cleaned  or  the 
tape  drive  unit  to  be  repaired. 


a.  UPT  Student  Data 


A  total  of  31  UPT  student  pilots  from  the  classes  of  7105  and 
7106  flew  aircraft  948  on  maneuver  data  collection  flights  conducted  by 
the  two  AFHRL  instructor  pilots.  Table  XV  presents  a  summary  of  these 
flights. 


The  original  plan  developed  for  the  UPT  data  collection  phase  was 
that  nine  to  twelve  UPT  student  pilots  would  be  randomly  selected  from 
two  flights  from  each  of  the  two  classes.  The  intent  was  to  collect 
maneuver  data  from  these  students  at  approximately  four  intervals  during 
their  Contact,  Advanced  Maneuver  phase  of  flying.  In  this  manner,  the 
authors  felt  that  representative  data  would  be  acquired  to  reflect  the 
learning  process  on  the  two  primary  maneuvers,  lazy  8  and  barrel  roll. 
However,  as  shown  in  Table  XV,  only  six  of  31  students  flew  more  than 
one  data  collection  flight  in  948.  Such  factors  as  the  rapid  rate  of 
student  progression  in  the  T-37  phase,  conflict  in  scheduling  missions 
fcr  the  appropriate  ATC  instructional  units,  turn-around  capability 
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TABLE  XV 


SUMMARY  OF  UPT  STUDENT  DATA  COLLECTION  FLIGHTS 


STUDENT 

FLIGHTS 

LAZY  8 

BARREL 

ROLL 

TRAFFIC 

PATTERN 

OTHER 

MANEUVERS 

i 

2 

4 

5 

2 

2 

1 

1 

5 

8 

1 

1 

3 

2 

0 

A 

1 

2 

2 

1 

ImiieHiann  -  2 

5 

1 

2 

2 

4 

6 

4 

10 

8 

4 

Clovorleaf-2,  Aileron  Roll-1 

7 

1 

3 

3 

1 

Ir.vnolnwnn  -1,  Cuban  8-1 

8 

1 

2 

4 

1 

9 

2 

3 

4 

1 

Cuban  8-1 

10 

1 

0 

1 

11 

1 

3 

3 

1 

Immelmann-l 

12 

2 

5 

4 

"7 

Inline  line.'c-l 

13 

1 

2 

0 

0 

14 

2 

6 

4 

1 

Loop-1 

15 

i 

2 
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of  948,  and  the  requirement  to  fly  UPT  students  on  a  non-interference 
basis  all  nosed  serious  limitations  to  the  achievement  of  the  original 
goals  for  student  data  collection.  In  effect,  the  data  acquired 
provided  a  larger  sample  size  and  thus  a  more  representative  range  of 
skill  level  of  UPT  student  pilots,  from  which  to  draw  lazy  8  and  barrel 
roll  maneuver  data  for  the  analysis  and  development  of  performance 
measures.  However,  measurement  validation  was  hampered  due  to  lack  of 
sufficient  data  per  individual  student. 

b.  Instructor  Pilot  Data 

Maneuver  data  was  collected  from  five  T-37  instructor  pilots  and 
is  summarized  in  Table  XVI.  A  highly  qualified  instructor  from  the 
T-37  Pilot  Instructor  Training  (PIT)  program  was  temporarily  assigned  to 
the  Pilot  Performance  Measurement  System  program  for  the  purpose  of  flying 
lazy  8  and  barrel  roll  maneuvers  that  represented  the  range  of  skill 
manifested  by  UPT  student  pilots  on  these  maneuvers.  The  PIT  IP  flew 
at  least  10  lazy  8 ' s  and  10  barrel  rolls  for  each  of  the  four  skill 
rating  categories  -  E,  G,  F,  and  U.  Additionally,  the  IP  described  the 
maneuver  verbally  as  he  was  performing  it.  Recorded  on  the  audio  tape, 
the  narrative  consisted  of  pointing  out  the  significant  parameters  and 
criterion  points  utilized  to  teach  the  maneuver  in  ATC,  normal  range  of 
values  around  the  criterion  points,  factors  that  affect  the  IP's  rating 
of  the  maneuver,  and  common  errors  experienced  by  UPT  students. 

Examples  of  the  IP's  description  of  the  maneuvers  can  be  found  in  the 
following  Section. 

Instructors  1  and  2  were  the  AFHRL  IP's  that  conducted  the  student 
data  collection  flights  while  Instructors  3  and  4  were  line  ATC  IP's. 

The  maneuver  data  from  these  five  instructor  pilots  provided  the 
authors  with  base-line  data  with  which  to  formulate  performance  measures 
for  the  quantitative  assessment  of  student  pilot  performance. 
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c.  Summary 

Several  factors  were  encountered  in  the  flight  testing  and  data 
collection  phase  that,  to  a  certain  extent,  altered  the  design  of  the 
Pilot  Performance  Measurement  System  program.  Primarily  these  factors 
consisted  of  limitations  in  the  recording  of  the  heading  parameter, 
reduced  resolution  capability  for  altitude,  reliability  problems 
experienced  with  the  magnetic  tape  recorder,  and  the  difficulty  in  the 
timely  scheduling  of  UPT  student  pilots.  This  in  no  way  detracts, 
however,  from  the  achievements  and  effectiveness  of  the  program  which, 
in  retrospect,  is  considered  to  have  been  quite  successful. 
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SECTION  VII 
MEASUREMENT  ANALYSIS 

In  this  Section,  final  measures  are  developed  for  recommended 
applications  in  measurement  of  the  lazy  8  and  barrel  roll.  Also 
included  are  some  relevant  observations  that  unfolded  regarding 
standardization  within  and  between  instructors  in  both  their 
performance  and  rating  of  the  maneuvers,  performance  criteria,  and 
methods  that  should  be  employed  in  developing  and  validating  measures 
in  future  efforts. 

The  authors  have  elected  to  present  these  findings  in  the  general 
order  in  which  they  develops  during  the  investigation.  First,  lazy  8 
measures  for  the  instructor  pilot  from  the  ATC  Pilot  Instructor  Training 
(PIT)  school  are  summarized  and  discussed.  The  measures  are  correlated 
with  the  subjective  ratings,  which  were  provided  in-flight  by  the 
performing  pilot.  This  is  done  for  the  purposes  detailed  on  pages  16-17 
of  this  report.  With  the  guidance  of  these  correlations,  and  with  the 
added  benefit  of  observing  trends  of  the  measures  (mean  and  standard 
deviations)  across  different  skill  levels,  a  simple  combination  of 
selected  measures  is  then  developed  and  shown  to  account,  in  itself, 
for  at  least  67%  of  the  variance  in  subjective  ratings. 


The  AFHRL  instructor  pilots'  lazy  8  performances  are  then  examined. 
Due  to  a  deficit  in  the  amount  of  data  collected  on  instructors  as  well 
as  a  lack  of  even  distribution  of  the  performances  across  all  four 
subjective  rating  categories  (as  judged  by  the  instructors  themselves 
in-flight),  the  only  topic  pursued  is  inter-  and  intra-instructor 
variance  in  performance.  For  this  Investigation,  the  PIT  instructor 
pilot  is  compared  with  AFHRL  and  ATC  instructor  pilots.  It  can  be 
shown,  for  example,  that  if  two  different  IP's  demonstrated  the  lazy  8 
for  a  given  student,  one  could  expect  as  much  as  27  knots  difference 
in  the  value  of  airspeed  at  one  critical  point  in  the  maneuver. 
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Next,  experimental  measures  for  student  performances  of  the  lazy  8 
are  examined.  As  in  the  case  of  the  PIT  IP  data,  correlations  are 
computed  between  measures  and  subjective  ratings.  Contrary  to  the  PIT 
data,  few  of  the  correlations  are  significant,  and  the  simple  combined 
measure  which  discriminated  skill  levels  quite  well  in  the  PIT  case 
appears  worthless  when  applied  to  the  student  data. 

At  this  point,  the  subject  of  validation  technique  is  addressed. 

The  authors  propose  (and,  but  for  lack  of  sufficient  data,  would  have 
used)  within-subject  sampling  as  an  ultimate  basis  for  validation  as 
well  as  development  of  measures.  This  validation  technique  is 
demonstrated  by  using  data  for  one  student,  for  which,  fortunately, 
sufficient  data  were  collected  to  at  least  illustrate  the  concept. 

Despite  the  complete  lack  of  validity  of  the  combined-error  measure 
seen  in  its  application  to  student  data  and  comparison  with  subjective 
ratings,  validity  is  supported  by  the  trend  of  the  measure,  as  it 
varies  across  one  student's  performances. 

To  further  support  the  lack  of  confidence  that  should  be  placed  in 
subjective  ratings  as  evidence  of  measurement  validity,  a  comparison  is 
made  of  instructors'  rating  standards.  This  is  pursued  by  comparing  the 
correlations  between  measures  and  subjective  ratings  for  one  IP  with 
those  for  a  second  IP.  It  is  shown  that  while  the  number  of 
significant  correlations  does  not  increase  appreciably  when  considering 
one  IP  at  a  time,  the  strength  of  lth£  correlations  for  various  measures 
differs  markedly  between  the  two  IP's.  This  suggests  a  difference  in 
emphasis  that  is  placed  by  the  two  IP's  on  various  aspects  of  the 
performance. 

Finally,  for  the  lazy  8  at  least,  a  set  of  final  measures  is 
recommended  along  with  a  summary  of  related  findings. 

The  barrel  roll  is  treated  next,  but  not  as  extensively  as  the 
lazy  8,  due  to  lack  of  sufficient  data.  The  experimental  measures 
for  student  data  are  presented  as  well  as  their  correlations  with 
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subjective  ratings.  The  indications  are  that  to  a  much  greater  extent 
than  in  the  lazy  8,  standards  must  be  determined  for  the  barrel  roll. 
Based  on  the  data  examined,  specific  measures  are  recommended  for 
validity  testing  in  future  studies. 

Finally,  some  plots  of  selected  variables  for  other  maneuvers  are 
presented.  The  maneuvers  are: 

Loop 

Stall 

Cl  overleaf 

Max.  Performance  Climbing  Turn 

Immelmann 

Cuban  8 

These  maneuvers  v/ere  not  addressed  from  a  measurement  standpoint,  but 
are  briefly  presented  here  merely  for  possible  reader  interest. 

With  this  introduction,  the  next  topic  presented  is  the  measurement 
analysis,  beginning  with  the  lazy  8. 

1 .  LAZY  8 

a.  PIT  Instructor/Pilot 

For  47  performances  by  a  single  PIT  instructor,  the  experimental 
measures  were  computed.  The  performances  were  rated  in-flight  by  the 
performing  pilot,  and  the  ratings  are  distributed  across  the  four  rating 
categories  as  shown  in  Figure  33. 

For  each  measure,  the  mean  and  standard  deviations  were  plotted  as 
shown  in  Figures  34  through  39.  In  addition,  each  measure  was 
correlated  with  the  subjective  ratings  assigned  to  each  performance. 

The  resulting  correlation  coefficients  are  presented  for  all 
performances,  all  right  performances,  and  all  left  performances  in 
Table  XVII. 
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TABLE  XVII 

CORRELATIONS  BETWEEN  MEASURES  AND  SUBJECTIVE 
RATINGS  FOR  PIT  INSTRUCTOR  LAZY  8  PERFORMANCES 


Measure 

Correlation  Coefficients 

All 

Right 

Left 

1 .  Max.  1  Pitch  (1 ) 

-0.11 

-0.16 

-0.09 

2.  Min.  1  Pitch  (2) 

0.51* 

0.48 

0.53* 

3.  Max.  2  Pitch  (3) 

-0.29 

-0.66 

-0.15 

4.  Min.  2  Pitch  (4) 

0.46* 

0.72* 

0.40 

5.  Roll  (1) 

-0.54* 

-0.32 

-0.60* 

6.  Roll  (2) 

-0.60* 

-0.59 

-0.73* 

7.  Roll  (3) 

-0.74* 

-0.56 

-0.80* 

8.  Roll  (4) 

-0.48* 

-0.52 

-0.60* 

9.  Airspeed  (1) 

-0.06 

0.17 

-0.09 

10.  Airspeed  (2) 

0.00 

0.24 

-0.05 

11.  Airspeed  (3) 

0.09 

0.67 

-0.14 

12.  Airspeed  (4) 

0.25 

0.64 

0.14 

13.  Altitude  (1) 

0.27 

-0.06 

0.12 

14.  Altitude  (2) 

0.15 

0.05 

0.18 

15.  Altitude  (3) 

0.31 

-0.06 

0.40 

16.  Altitude  (4) 

0.33 

0.13 

0.37 

17.  Max.  Roll 

-0.64* 

-0.31 

-0.72* 

18.  Min.  Roll 

0.60 

0.66 

0.56* 

IS.  Time  (half  1) 

0.23 

-0.33 

0.56* 

20.  Time  (half: 2) 

0.60* 

0.47 

0.57* 

21.  Total  Time 

0.61* 

0.42 

0.68* 

22.  Airspeed  Error  1 

-0.41* 

-0.41 

-0.42 

23.  Airspeed  Error  2 

-0.62* 

-0.66 

-0.62* 

24.  Airspeed  Error  3 

-0.43* 

-0.47 

-0.43 

25.  Airspeed  Error  4 

-0.58* 

-0.87* 

-0.48* 

26.  Airspeed  Error  5 

-0.58* 

-0.70 

-0.54* 

27.  Sum  (1-5) 

-0.74* 

-0.87* 

-0.70* 

28.  Sum  (1-3) 

-0.69* 

-0.74* 

-0.67* 

29.  Sum  (3-5) 

-0.71* 

-0.87* 

-0.66* 

30.  Delta  Airspeed  (1) 

-0.09 

-0.35 

-0.02 

31.  Delta  Airspeed  (2) 

-0.07 

-0.28 

-0.02 

32.  Delta  Airspeed  (3) 

-0.22 

-0.59 

-0.05 

33.  Delta  Airspeed  (4) 

-0.05 

-0.64 

0.15 

34.  Airspeed  Rate  (1) 

-0.27 

-0.33 

-0.29 

35.  Airspeed  Rate  (2) 

-0.38* 

-0.47 

-0.36 

36.  Airspeed  Rate  (3) 

-0.51* 

-0.63 

-0.46* 

37.  Airspeed  Rate  (4) 

-0.40* 

-0.68 

-0.27 

38.  Time  (1) 

0.31 

-0.04 

O.'O 

39.  Time  (2) 

0.57* 

0.49 

0.59* 

40.  Time  (3) 

0.50* 

0.05 

0.61* 

41.  Time  (4) 

0.40* 

0.36 

0.44 

*Significant  to  0.01  level 
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Debriefing  plots  for  each  performance  were  also  produced  and  used  as 
an  aid  in  the  analysis.  Where  available  the  pilot's  voice  transcript 
was  attached  to  the  appropriate  set  of  plots.  Sample  plots  for  one  of 
the  performances  are  presented  in  Figures  40  through  42.  (Refer  to 
Appendix  XVI  for  interpretation  of  the  plots.) 

Using  this  data  it  was  possible  to  make  a  number  of  general 
observations  that  provide  insight  to  general  performance  of  the  lazy  8 
as  well  as  to  its  measurement.  These  observations  are  presented  next. 
They  are  based  primarily  on  the  data  in  Figures  34  through  39. 

(1)  General  Observations 

The  following  observations  are  based  exclusively  on  the  PIT 
Instructor  performance  data  as  shown  in  Figures  34  to  39,  Table  XVII, 
and  (although  not  shown)  the  debriefing  plots.  In  the  ensuing 
presentation  of  the  observations,  this  qualification  prevails.  No 
use  will  be  made  of  additional  qualifiers  (e.g.,  "it  appears...")  as 
is  the  normal  tendency  when  presenting  data  of  this  type. 

In  performance  of  the  lazy  8,  positive  pitch  excursions  exceed 
negative  pitch  excursions  by  at  least  10  (Figure  34,  a-d).  This  is 
not  in  accordance  with  the  original  maneuver  analysis  performed  by  ATC. 
Since  the  airspeed  should  vary  between  200  and  100  knots,  the  probable 
reason  for  positive  and  negative  pitch  excursions  being  unequal  is 
(a)  the  pilot  attends  to  airspeed  and  not  to  pitch  and  (b)  the  aircraft 
accelerates  and  gains  airspeed  in  a  nose-down  configuration  faster  than 
it  decelerates  and  loses  airspeed  in  a  nose-up  configuration. 

Generally,  greater  pitch  excursions,  both  positive  and  negative, 
are  experienced  in  the  poorer  performances.  Also  much  more  variance  in 
pitch  occurs  in  the  second  half  of  the  maneuver  than  in  the  first  half 
for  poor  performances.  This  is  probably  due  to  the  accumulated  effect 
of  errors  on  other  parameters  incurred  in  the  first  half  (especially 
airspeed  errors)  ar.d  the  ensuing  attempt  on  the  part  of  the  pilot  to 
"make  up"  for  these  errors  in  the  second  half.  Pitch  variance 
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12-19-69 
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tl  LEFT) 


(12-19-69  EVNO  71  1  LEFT) 

The  student  pilot  turns  up  almost  to  the  north  to  do  a  lazy  8  to  the 
left.  This  time  the  student  is  starting  out  almost  exclusively  with 
pitch  and  very  little  bank  change.  Now  with  the  pitch  attitude  of 
about  60°,  he  Is  rolling  into  the  bank,  slicing  the  nose  down  through 
after  approximately  90°  of  turn,  down  below  the  point  of  the  configuration, 
rolls  out,  makes  a  stra1ght-ahead  pullup  by  proceeding  to  come 
through  with  approximately  200  knots.  He  Is  essentially  making  the 
maneuver  easier  for  himself  by  not  changing  all  the  parameters  at  once. 

That  would  have  been  an  unsatisfactory  lazy  8. 


Figure  40.  Roll  vs  Pitch  Plot 
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Figure  41.  Airspeed  Plot 
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noticeably  increases  as  skill  ratings  decrease  (e.g.,  as  ratings  proceed 
from  excellent  to  unsatisfactory). 

As  skill  ratings  decrease,  there  is  a  noticeable  increase  in  the 
value  of  roll  angle  achieved  at  the  points  of  local  maximum  and  minimum 
pitch  (Figure  34,  e-h).Thus,  both  roll  and  pitch  exhibit  wider 
excursions  for  lower  skilled  performances. 

There  is  a  very  evident  increase  in  the  variance  on  airspeed 
measures  as  skill  ratings  decrease  (Figure  35,  a-d).  This  is  particularly 
obvious  in  discriminating  fair  from  unsatisfactory  performance. 

However,  there  is  little  change  in  the  actual  airspeed  measures 
themselves,  the  only  possible  exception  being  in  the  fourth  quarter  of 
the  maneuver  where  the  measures  are  lower  for  unsatisfactory 
performances. 

There  is  an  observable  increase  in  the  variance  on  altitude 
excursions  as  skill  ratings  decrease,  but  this  is  true  for  only  the 
first  half  of  the  maneuver  (Figure  35,  e-h).  In  the  second  half,  the 

same  tendency  is  observed  only  from  fair  to  unsatisfactory  degradation. 
Over  the  whole  maneuver,  an  overall  altitude  gain  ranging  from  100  to 
1000  ft  is  usually  observed,  but  there  is  no  apparent  correlation 
between  altitude  gained  and  skill  level. 

The  maximum  positive  and  negative  roll  angles  achieved  in  the 
maneuver  show  a  definite  increase  in  value  as  skill  ratings  vary  from 
the  excellent  or  good  category  to  fair  and  unsatisfactory  (Figure  36, 
a-b).  Again,  this  supports  previously  discussed  observations  regarding 
greater  parameter  excursions  in  general  as  skill  ratings  decrease.  The 
variance  on  maximum  roll  angles  shows  an  increase  only  from  fair  to 
unsatisfactory  performances. 

There  is  a  general  decreasing  trend  in  the  time  taken  to  perform 
the  maneuver  as  skill  ratings  decrease,  but  there  is  no  significant 
change  in  variance  (Figure  36,  c-e).  This  illustrates  a  tendency  to 
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perform  the  maneuver  faster  (and  with  wider  pitch  and  roll  excursions) 
in  the  lower  skill  categories;  however,  time  as  a  measure  is  not 
expected  to  be  significant. 

Airspeed  errors  and  the  variances  thereof  show  a  noticeable  increase 
as  skill  ratings  decrease,,  particularly  at  the  points  of  maximum 
positive  or  negative  roll  (i.e.,  at  the  end  of  the  first  and  third 
quarters  of  the  maneuver.  Figure  37,  a-h). 

Airspeed  excursions  show  an  obviojs  increase  in  variance  as  skill 
ratings  decrease  (Figure  38,  a-d).  This  is  particularly  evident  in 
the  second  half  of  the  maneuver  from  the  excellent/good  to  the  fair/ 
unsatisfactory  categories. 

The  rate  of  change  of  airspeed  with  respect  to  time  is  generally 
lower  in  the  first  and  fourth  quarters  than  in  the  second  and  third 
quarters  (rates  begin  and  end  slowly  with  respect  to  the  middle  portions 
of  the  maneuver)  (Figure  38,  e-h).  The  widest  variances  occur  as  well 
in  the  first  and  fourth  quarters,  particularly  for  unsatisfactory 
performances. 

Contrary  to  guidelines  used  by  many  instructors  in  teaching  and 
performing  the  lazy  8,  the  value  of  airspeed  at  points  of  maximum 
positive  and  negative  pitch  does  not  appear  to  be  150  knots  as  judged 
by  the  PIT  Instructor  data.  Observation  of  this  came  first  from 
analysis  of  the  debriefing  plots  and  is  substantiated  by  the  mean-data 
presented  in  Figure  35  (a,  b,  c,  and  d).  Following  is  a  presentation 
of  the  first  several  lazy  8s  flown  by  the  PIT  instructor  and,  where 
available,  his  recorded  comments.  In  addition  to  providing  a  number 
of  insights  to  the  correct  performance  of  the  maneuver,  this 
presentation  will  illustrate  the  errors  incurred  when  the  pilot 
attempted  to  use  150  knots  as  a  check  point;  and  the  improvement  of 
the  performances  when  he  apparently  abandoned  its  use. 
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Performance  1  (11-18-69,  event  4)  Rating:  Good 


Pilot’s  Commentary:  "As  you  know,  the  lazy  8  is  a  maximum  performance 
maneuver  where  we  will  attempt  to  fly  the  airplane  through  a  wide  range 
of  airspeeds,  bank  angles,  and  pitch  attitudes.  Power  is  90%,  our 
entry  airspeed  is  200  knots;  speed  brake  is  up.  To  accomplish  the 
maneuver  we  will  start  a  climbing  turn  very  similar  to  a  climb  for  a 
maximum  performance  climbing  turn,  planning  to  have  our  maximum  pitch 
attitude  after  45°  of  turn,  or  right  about  now.  Airspeed  should  be 
approximately  150  knots.  The  nose  begins  to  come  down  at  this  time. 
Bank  is  still  increasing.  Nose  through  the  horizon  after  90°  of  turn, 

down  to  its  lowest  point.  You  will  notice  that  the  airspeed  was  high 

during  the  point  the  nose  came  through  the  horizon,  down  to  the  nose 
lowest  after  135°  of  turn.  Back  up  to  200  knots  and  level  flight  now. 
Try  to  correct  the  mistake  I  made  during  the  first  half  of  that  one  by 
increasing  my  pitch  more  during  the  first  half  of  this  next  maneuver  and 
getting  my  airspeed  down,  planning  to  come  through  after  90°  of  turn. 
Airspeed  still  a  little  high,  about  114  knots.  Nose  lowest  after  135, 
back  up  to  level  flight  after  180°  of  turn.  End  of  maneuver.  I  would 
have  graded  that  one  about  a  low  good  or  a  high  fair.  Lets  call  it  a 
good  maneuver." 
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Performance  2  (11-18-69,  event  5) 

I 


AIRSPEED 


Rati ng :  Good 


Pilot's  Commentary:  "Ready  to  start  into  lazy  8  number  2.  Continuing 
the  maneuver,  trying  to  adjust  my  airspeed  this  time  so  that  it  comes 
down  to  100  knots,  and  you  will  notice  that  I  did  not  get  it.  We  will 
come  back  to  straight  and  level  flight,  200  knots,  and  I  will  again 
try  to  get  the  pitch  up  further  so  that  I  get  down  to  100  knots.  And 
I  am  still  coming  through  with  112.  Now  the  reason  I  am  grading  this 
good  is  that  I  have  the  basic  nose  track  correct.  However  I  am  not 
hitting  the  proper  parameters.  This  maneuver  is  complete  and  I  would 
have  graded  it  good." 


Performance  3  (11-18-69,  event  6) 


Rating:  Good 


\ 


4 
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Pilot's  Commentary:  "Okay,  I  will  again  attempt  to  correct.  Apparently 
the  cooler  day  has  given  me  a  good  deal  more  aircraft  performance  than 
I  was  expecting.  I  am  starting  the  nose-up  at  a  higher  rate  of  change 
than  I  have  been  doing,  getting  maximum  pitch  after  45°.  Bank 
contiiuing  to  increase.  Nose-down  through  the  horizon  after  90°  of 
turn,  airspeed  98  knots.  At  its  lowest  after  135°  of  turn.  I  am  not 
getting  the  nose-down  low  enough;  as  a  result  I  am  coming  back  through 
with  a  little  lower  airspeed  on  this  one...  95  knots  at  its  lowest;  now 
let  us  go  down  a  little  lower  as  the  bank  decreases,  planning  to  come 
back  to  level  flight  again  at  200  knots  and  straight  and  level  flight. 

End  of  lazy  8  number  3.  I  would  have  graded  that  one  a  high  good  or 
low  excellent.  Call  it  a  good.  I'd  like  to  get  just  one  excellent 
while  we  are  out  here  today!" 

Performance  4  (11-18-69,  event  7)  Rating:  Excellent 


Pilot's  Commentary:  None  recorded 
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Performance  5  (11-18-69,  event  13) 


Rating:  Good 


Pilot's  Commentary:  "Starting  our  pullup...get  the  pitch  attitude  to 
its  highest  point  at  45°  of  turn;  and  I'm  through  with  high  airspeed 
again.  Try  to  correct  it  on  the  second  half  of  this  maneuver,  nose 
lowest  after  135  with  approximately  150  knots.  Again  I  will  attempt 
to  correct  by  pulling  the  nose  up  at  a  faster  rate  to  begin  with, 
airspeed  at  its  lowest  after  90°  of  turn,  pitch  at  its  lowest  on  45°, 
back  to  straight  and  level  after  180?.  That  one  I  would  have  graded 
good.  The  reason  for  the  good  is  a  low  airspeed  during  the  first  half 
of  the  maneuver.  The  second  half  I  thought  was  a  pretty  good  maneuver." 


(2)  Simplified  Combination  Error  Measure 

Based  on  the  foregoing  observations  and  analysis  data,  a 
simple  combination  error  measure  was  derived  and  computed  for  each 
performance.  The  measure  is  based  on  criteria  for  roll,  pitch,  and 
airspeed  determined  from  the  representative  data.  The  criteria  are: 


^,6,7,8 
M9,  10,  11, 


=  First  max.  positive  pitch*  40° 

=  First  miri.  negative  pitch  *-26° 

=  Second  max.  positive  pitch  =  40° 

=  Second  min.  negative  pitch  =  -26° 

=  R°11  atN,.2j3j4.45” 

12  =  Airspeed  at  2,  3,  4*  133  knots 
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The  combined  measure  is 


where  cM  =  criterion 


and  rM  =  recorded  M, , 

M.  i 


Figure  43  shows  this  computed 


measure  for  the  47  PIT  Instructor  lazy  8s. 


Note  that  the  measure  easily  and  clearly  discriminates,  between 
excellent  and  fair  levels  of  performance.  Fair  versus  unsatisfactory 
is  also  discriminated  well,  the  only  exception  being  a  performance  that 
was  judged  to  be  unsa  isfactory  by  the  instructor  but  which  was 
commented  upon  as  being  "maybe  a  low  fair"  by  the  same  instructor. 
Similarly,  other  performances  whose  assigned  ratings  appear  questionable 
by  standards  of  the  measure  were  found  to  have  associated  instructor 
comments  supporting  the  measure's  validity  (Figure  43). 

This  measure  alone  accounts  for  67%  of  the  variance  in  instructor 
ratings,  considering  all  performances.  If  ratings  for  the  three 
performances  footnoted  in  Figure  43  are  changed  as  dictated  by  the 
instructor's  recorded  comments,  the  measure  would  account  for  72%  of 
the  variance. 

In  light  of  the  simplicity  of  the  measure  (sampling  three  variables 
at  four  discrete  points  in  the  maneuver)  and  the  fact  that  absolutely  no 
weighting  was  performed  In  its  computation  (straight  error  sum),  the 
results  are  quite  remarkable.  It  Is  hypothesized  that  use  of  an 
integrated  error  measure  on  the  roll /pitch  relationship  and  the 
employment  of  linear  weighting  would  easily  improve  the  measure  20  to 
25%,  as  evaluated  by  its  correlation  with  subjective  ratings. 


Combination  Error  Measure 
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Figure  43.  Combination  Error  Measure  for  47  PIT  Instructor  Lazy  8 
Performances 
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(3)  Debriefing  Plots 

Figure  44  shows  a  smoothed  mean  roll-pitch  profile  for  the 
PIT  instructor  excellent  left  performances.  Also  shown  for  comparison 
is  an  example  of  unsatisfactory  performance  as  it  might  be  overlaid 
and  annotated  in  a  finished  debriefing  plot. 

b.  AFHRL  and  ATC  Instructors 

Sixteen  Lazy  8  performances  by  four  different  instructor  pilots 
were  analyzed.  Most  of  these  were  performed  during  student-instruction 
to  demonstrate  proper  performance  of  the  maneuver.  The  performances 
were  rated  by  the  IP's  and  are  distributed  across  the  rating  categories 
as  shown  in  Figure  45;  some  performances  have  no  rating  associated  with 
them. 

With  so  few  samples  per  IP,  little  could  be  gained  by  analysis  of 
mean  measures  versus  rating  category  or  by  correlations  of  measures  with 
subjective  ratings.  It  is  of  interest,  however,  to  examine  intra- 
and  inter-instructor  variance  and  technique.  For  this  purpose, 
thirteen  measures  (numbers  1-12  and  27  in  Table  XVII)  were  selected 
for  analysis. 

Since  only  one  sample  was  obtained  for  one  of  the  four  instructors, 
he  was  omitted  from  the  analysis.  Included,  then,  were  three  AFHfeL 
or  ATC  IPs  and  the  PIT  IP,  the  latter's  performances  being  chosen  as 
all  those  rated  excellent.  Table  XVIII  shows  the  average  standard 
deviation  for  each  measure,  taken  across  all  4  pilots;  and  the 

standard  deviation  of  the  average  measures.  The  former  provides  some 

/ 

indcation  of  intra-instructor  variance;  the  latter  provides 
indication  of  inter-instructor  variance. 

For  most  measures,  the  amount  of  variation  between  the  average 
performances  of  the  IPs  is  roughly  equivalent  to  the  amount  of  variation 
within  a  given  IP.  To  interpret  the  meaning  of  these  statements,  we 
shall  use  the  example  of  measure  number  9,  the  airspeed  sampled  in  the 
third  quarter  of  the  maneuver  at  the  point  of  maximum  positive  pitch. 
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Figure  44. 


Sample  Annotated  Debriefing  Plot 


K'o.  of 


AFHRL-TR-72-6 


Intra- Instructor*  Inter-Instructor** 
Variance  Ind.  Variance  Ind. 


*  Average  standard  deviation  for  4  IPs 

**  Standard  deviation  of  averages  of  measures  for  4  IPs 
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The  statement  implies  the  possibility  that  (1)  a  given  IP's 
demonstration  of  the  maneuver  could  be  expected  to  result  in  an  airspeed 
variation  (on  this  measure)  of  18  knots;  and  (2)  if  two  different 
IPs  demonstrated  the  maneuver,  the  variation  could  be  as  much  as  27 
knots,  considering  all  performances  of  both  IPs. 

Measures  1  and  7,  the  maximum  positive  pitch  values  in  the  1st  and 
3rd  quarters,  show  very  little  inter-instructor  variance.  Although 
each  IP  could  be  expected  to  vary  +4  to  +6  degrees,  the  instructors  are 
consistent  in  that  their  average  performances  would  probably  vary  by  only 
+1°.  Similarly,  measure  13,  the  sum  of  5  airspeed  errors,  shows 
consistency  across  Instructors  insofar  as  average  performances  are 
concerned. 


c.  Students 


Forty-two  performances  of  16  different  student  pilots  were 
analyzed,  with  the  performances  rated  by  the  accompanying  IP  and 
distributed  across  rating  categories  as  shown  In  Figure  46.  Table  XIX 
lists  general  data  on  the  students  comprising  the  sampling  population. 
Also  shown  in  Table  XIX  are  codes  representing  which  of  two  IPs  flew 
with  and  rated  each  student. 


Figures  47  to  52  illustrate  plots  of  mean  and 
for  the  41  measures.  Correlations  between  measures 
ratings  for  all  student  performances  are  provided  in| 
Debriefing  plots  were  also  generated  for  use  in  the 


standard  deviations 
and  subjective 
Table  XX. 
Analysis. 


Roll  and  pitch  excursions  and  variances  Increase  slightly  as  skill 
ratings  decrease.  However,  the  amount  of  increase  from  fair  to 
unsatisfactory  is  noticeably  less  than  for  the  PIT  instructor  data. 

This  could  be  due  to  different  rating-standards  between  IPs. 

Airspeed  values  at  points  of  maximum  pitch  excursion  are  noticeably 
higher  for  students  than  for  the  PIT  IP.  Variances  in  the 
unsatisfactory  performances  are  less. 
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Airspeed  Error  Measures  for  Student 


A-Airsp.  (qtr.  I) 
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Rating 

(a) 


Rating 

(c) 


(d) 


Figure  52.  Time  Measures  for  Student  Lazy  8's  [Mean  +  1  <r] 
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TABLE  XX 

CORRELATIONS  BETWEEN  MEASURES  AND  SUBJECTIVE  RATINGS 
FOR  STUDENT  LAZY  8s 


Measure  Number 

1. 

Max.  1  Pitch 

M ) 

2. 

Min.  1  Pitch 

(2) 

3. 

Max.  2  Pitch 

(3) 

4. 

Min.  2  Pitch 

(4) 

5. 

Roll  (1) 

6. 

Roll  2) 

7. 

Roll  (3) 

8. 

Roll  (4) 

9. 

Airspeed  (1) 

10. 

Airspeed  (2) 

11. 

Airspeed  (3) 

12. 

Airspeed  (4) 

13. 

Altitude  (1) 

14. 

Altitude  (2) 

15. 

Altitude  (3) 

16. 

Altitude  (4) 

17. 

Max.  Roll 

18. 

Min.  Roll 

19. 

Time  (half  1) 

20. 

Time  (half  2) 

21. 

Total  Time 

22. 

Airspeed  Error  1 

23. 

Airspeed  Error 

2 

24. 

Airspeed  Error 

3 

25. 

Airspeed  Error  4 

26. 

Airspeed  Error 

5 

27. 

Summary  (1-5) 

28. 

Summary  (1-3) 

29. 

Summary  (3-5) 

30. 

Delta  Airspeed 

(1) 

31. 

Del  ta  Ai rspjed 

(2) 

32. 

Delta  Airspeed 

(3) 

33. 

Delta  Airspeed 

(4) 

34. 

Airspeed  Rate 

(D  J 

35. 

Airspeed  Rate 

(2) 

36. 

Airspeed  Rate 

(3) 

37. 

Airspeed  Rate 

(4) 

38. 

Time  (1) 

39. 

Time  (2) 

40. 

Time  (3) 

41. 

Time  (4) 

TTT 


Correlation  Coefs, 
IW 


‘0.05 

0.02 

-0.28 

0.27 

-0.21 

-0.17 

-U.25 

-0.17 

-0.20 

-0.21 

-0.07 

-0.04 

0.29 

0.31* ** 

0.27 

0.26 

-0.39** 

0.21 

0.02 

0.07 

0.13 

0.03 

-0.19 

-0.16 

-0.15 

-0.14 

-0.24 

-0.19 

-0.27 

0.35** 

0.09 

-0.16 

-0.06 

0.25 

0.05 

-0.23 

-0.06 

-0.05 

0.10 

0.10 

0.00 


C.48 
0.30 
0.02 
0.02 
-0.04 
-0.60** 
-0.12 
-0.24 
-0.44 
-0.54** 
-0.15 
-0.10  . 
0.20 
0.33 
-0.02 
0.12 
-0.45 
0.21 
0.45 
-0.22 
0.20 
0.01 
-0.30 
-0.38 
-0.11 
0.03 
-0  34 
-0.42 
-0.32 
0.46 
0.26 
-0.08 
0.15 
0.28 
-0.07 
0.10 
0.09 
0.34 
0.36 
-0.24 
-0.06 


Left 


-0.12 

-0.03 

-0.38 

0.44** 

-0.32 

-0.02 

-0.30 

-0.16 

-0.11 

-0.08 

-0.05 

-0.02 

0.41** 

0.33 

0.39** 

0.32 

-0.40** 

0.23 

-0.12 

0.21 

0.10 

0.04 

-0.15 

-0.06 

-0.18 

0.25 

-0.20 

-0.11 

-0.25 

0.33 

-0.00 

-0.22 

-0.19 

0.24 

0.11 

-0.44** 

-0.15 

-0.16 

-0.11 

0.32 

0.04 


*  Significant  to  0.01  level 

**  Significant  to  0.05  level 
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Altitude  excursions  for  students  are  on  the  order  of  300  and  600  ft 
less  (in  first  and  second  halves  of  maneuver,  respectively)  than  for 
the  PIT  IP.  This  is  probably  due  to  the  varying  environmental  conditions 
(and,  therefore,  aircraft  performance)  in  which  the  sorties  were 
flown.  The  AFHRL  and  ATC  IP  data  shows  altitude  excursions  similar  to 
those  of  the  students,  suggesting  that  it  is  not  due  to  differences 
between  students  and  IPs  as  classes  of  subjects. 

Maximum  roll  angles  attained  in  the  maneuver  have  greater  variance 
across  all  skill  categories  for  students  than  for  the  PIT  IP.  Similarly, 
the  total  time  to  perform  the  maneuver,  while  having  about  the  same 
mean,  has  much  wider  variances. 

Unlike  the  PIT  case,  airspeed  errors  appear  to  have  no  relationship 
to  skill  category  for  the  student  data  (Figure  50).  It  is  strongly 
suspected  that  this  is  due  to  a  difference  in  rating-standards  among 
IPs,  i.e.,  a  difference  in  the  assumed  importance  of  airspeed  in 
grading  the  maneuver.  This  is  substantiated  later  in  this  Section 
where  we  examine  trends  of  measures  for  an  individual  student;  it  also 
signals  clearly  one  of  the  shortcomings  of  using  IP  ratings  as  a  guide 
in  the  development  of  measures. 

Another  major  difference  between  the  student  and  PIT  data  is  the 
airspeed  value  at  the  points  of  maximum  pitch  excursion.  Recall  that 
the  PIT  IP  at  first  was  striving  for  150  knots  at  these  points  and  was 
forced  to  reduce  this  value  to  about  133  knots  in  order  to  accomplish 
the  maneuver  correctly.  However,  150  knots  appears  to  work 
satisfactorily  as  judged  by  the  student  data.  It  is  suspected  that 
differences  in  aircraft  performance  in  different  environmental  conditions 
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Correlations  between  measures  and  subjective  ratings  for  students 
are,  in  general,  insignificant.  This  is  in  direct  contrast  to  the 
PIT  case,  where  a  number  of  significant  coefficients  were  found. 

Again,  this  appears  to  be  due  to  the  IP's  rating  techniques  for  the 
student  data,  and  this  will  be  further  substantiated  later  in  this 
Section. 

The  combination  error  measure  that  discriminated  performances  so 
well  for  the  PIT  data  (Figure  43)  was  computed  for  the  student  data. 

The  results  are  shown  in  Figure  53.  The  complete  lack  of  discrimination 
is  evident. 

d.  Within-Subject  Sampling  as  a  Basis  for 
Measurement  Development 

Until  now,  we  have  referenced  instructor  ratings  as  a  guideline  for 
the  development  of  measures  and  for  demonstrating  their  face-validity. 
This  approach,  as  the  sole  approach,  has  serious  shortcomings  because 
it  is  based  on  the  assumptions  that  (1)  all  instructors  or  raters 
apply  the  same  standards  and,  for  the  most  part  at  least,  are 
consistent  and  reliable  in  their  use  of  the  (four)  rating  categories; 
and  (2)  the  standards  that  are  applied  are  valid.  The  authors 
contend  that  neither  assumption  is  true. 

This  is  not  to  say  that  the  use  of  instructor  ratings  as  initial 
guidelines  in  the  development  of  measures  is  not  valuable.  A  great 
deal  of  insight  to  the  measurement  of  maneuvers  can  very  definitely  be 
attained  by  examination  of  subjective  ratings.  However,  the  use  of 
subjective  ratings  in  the  development  of  objective  measures  is  in  itself 
a  dichotomy,  and  such  use  must  be  made  with  caution  and  with  the 
understanding  that  both  reliable  standards  and  rating-standardization 
can  be  expected  to  be  lacking  in  the  subjective  system. 
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Another  approach  is  to  accomplish  measurement  development  and 
(equally  important)  to  validate  measures  using  within-subject  sampling. 
With  this  approach,  the  major  assumption  is  that  learning  occurs  with 
time  and  practice  of  a  maneuver.  Individual  measures  that  are  developed 
should  reflect  all  or  a  part  of  that  learning  through  their  trends  from 
day  No.  1  of  instruction  on  a  maneuver  through  the  final  day  of  training 
for  each  student. 

In  the  present  study,  this  approach  was  originally  a  part  of  the 
experimental  design;  however,  it  was  impossible  to  apply  in  toto  due 
to  difficulties  encountered  in  collecting  a  lot  of  data  per  student  for 
all  students  sampled.  It  was  possible,  however,  to  attain  sufficient 
data  for  one  student  to  illustrate  the  approach.  These  results  will  be 
discussed  next. 


(1)  Example  for  a  Single  Student 

For  student  number  6  (Table  XIX),  eight  performances  of  the 
lazy  8  were  recorded  during  three  different  sorties.  The  sot  ties  were 
separated  by  1.5  and  17.2  flight  hours  and  by  2  and  i9  cays,  respectively. 
For  reference,  the  performances  are  numbered  1  to  8,  with  1-3  flown  on 
the  first  sortie  recorded,  4-5  on  the  second  sortie,  and  6  8  on  the 
third  sortie.  (In  order,  the  sorties  were  rated  F,  F,  F,  F,  F,  G,  G,  F.) 

Figures  54  to  59  show  each  of  the  individual  measures  for  the 
8  performances  of  this  student.  Figure  60  shows  the  combination  error 
measure  for  this  student  and  for  a  second  student  (no.  14)  for  which 
6  performances  were  recorded  on  2  separate  sorties.  One  measure  whose 
trends  are  more  obvious  than  others  is  the  change  in  airspeed  in  the 
4  quarters  of  the  maneuver  (Figure  58,  a-d).  Assuming  the  ATC 
excursion  limits  of  100  to  200  knots  is  correct,  this  measure  should 
trend  to  100  knots.  The  plots  demonstrate  this  clearly.  Also,  the 
airspeed  error  measures  (Figure  57)  show  a  distinct  decrease  in  error 
from  early  samples  to  later  samples. 
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Figure  56.  Roll  and  Time  Measures  for  Single  Student  Performances 
of  the  Lazy  8 


Figure  58.  Airspeed  Excursion  and  Rate  Measures  for  Single  Student 
Performance  of  the  Lazy  8 
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Also  relevant  is  the  combination  error  measure  of  Figure  60. 

Although  there  was  little  if  any  correlation  between  this  measure  and  the 
subjective  ratings  for  all  students  (Figure  53),  the  trends  of  this 
measure  acrcss  single  student  sorties  show  definite  trends  toward  a 
decrease  in  error,  as  would  be  expected.  On  the  Figure  60  plot,  the 
measure  is  also  shown  for  students  numbers  6  and  14.  Both  students' 
data  substantiates  the  validity  of  the  measure  despite  its  lack  of 
correlation  with  subjective  ratings. 

e.  Comparison  of  Instructor  Rating  Standards 

Because  of  the  low  correlations  between  measures  and  subjective 
ratings  for  the  student  data  (Table  XX),  inconsistency  between  the 
two  involved  IPs  is  suspect.  To  pursue  this  idea  a  little  further, 
separate  correlations  for  each  IP  were  computed  and  are  shown  in 
Table  XXI  along  with  those  for  both  IPs  together. 

The  number  of  significant  correlations  (0.05  level  or  better)  does 
not  increase  appreciably  considering  one  IP  at  a  time.  However,  some 
significant  differences  between  correlations  for  the  two  IPs  are  noted. 
For  IP-1,  a  significant  positive  correlation  exists  for  the  first 
maximum  positive  pitch,  whereas  only  a  small  correlation  (0.08)  is 
shown  for  IP-2.  Also,  for  the  value  of  roll  at  the  first  minimum 
negative  pitch,  IP-1  shows  a  correlation  of  opposite  sign  and  roughly 
equal  level  of  significance  to  that  of  IP-2. 

For  altitude  variations,  correlations  for  IP-2  are  consistently 
higher  than,  for  IP-1.  At  the  point  of  first  maximum  positive  pitch, 
for  example,  correlations  were  0.66  and  0.16  for  IP-2  and  IP-1, 
respectively. 

For  time  measures,  correlations  for  the  two  IPs  are  generally  small 
but  of  opposite  signs.  The  most  significant  difference  is  for  time  to 
perform  the  second  quarter  of  the  maneuver,  where  the  correlations  are 
-0.62  and  0.35  for  IP-2  and  IP-1  respectively. 
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TABLE  XXI 


CORRELATIONS  BETWEEN  IP  RATINGS  AND  MEASURES 


Measure  Number 

IP-1 

n*»31 

IP-2 

n=ll 

Both  IPs 
n=42 

1. 

Max.  1  Pitch 

(1) 

0.37** 

'Eli 

0.05 

2. 

Min.  1  Pitch 

(2) 

-0.10 

0.02 

3. 

Max.  2  Pitch 

(3) 

-0.11 

"ESS*- 

-0.28 

4. 

Min.  2  Pitch 

(4) 

-0.09 

0.37 

0.27 

5. 

Roll  (1) 

-0.14 

-0.01 

-0.21 

6. 

Roll  (2) 

-0.28 

0.33 

-0.17 

7. 

Roll  (3) 

-0.34 

-0.05 

-0.25 

8. 

Roll  (4) 

0.00 

0.08 

-0.17 

9. 

Airspeed  (V 

-0.26 

-0.40 

-0.20 

10. 

Airspeed  (2, 

-0.37** 

-0.23 

-0.21 

11. 

Airspeed  (3 

-0.14 

-0.36 

-0.07 

12. 

Airspeed  (4^ 

-0.06 

-0.25 

-0.04 

13. 

Altitude  (l) 

0.16 

0.66** 

0.29 

14. 

Altitude  (2] 

0.27 

0.48 

0.31** 

15. 

Altitude  (3j 

0.19 

0.54 

0.27 

16. 

Altitude  (4' 

0.16 

0.60 

0.26 

17. 

Max.  Roll 

-0.31 

-0.26 

-0.39** 

18. 

Min.  Roll 

0.03 

-0.14 

0.21 

19. 

Time  (half  1) 

0.29 

-0.48 

0.02 

20. 

Time  (half  2) 

-0.02 

0.19 

0.07 

21. 

Total  Time 

0.27 

-0.25 

0.13 

22. 

Airspeed  Error 

1 

0.19 

-0.22 

0.03 

23. 

Airspeed  Error 

2 

-0.35 

-0.27 

-0.19 

24. 

Airspeed  Error 

3 

-0.25 

-0.07 

-0.16 

25. 

Airspeed  Error 

4 

-0.25 

-0.74** 

-0.15 

26. 

Airspeed  Error 

5 

-0.03 

-0.30 

-0.14 

27. 

Summary  (1-5) 

-0.34 

-0.44 

-0.24 

28. 

Summary  (1-3) 

-0.30 

-0.25 

-0.19 

29. 

Summary  (3- 

5) 

-0.37** 

-0.46 

-0.27 

30. 

Delta  Airspeed 

(1) 

0.48* 

0.45 

0.35** 

31. 

Delta  Airspeed 

(2) 

0.24 

-0.01 

0.09 

32. 

Delta  Airspeed 

(3 

-0.01 

-0.30 

-0.16 

33. 

Delta  Airspeed 

4 

0.16 

-0.20 

-0.06 

34. 

Airspeed  Rate 

(1) 

0.38** 

0.48 

0.25 

35. 

Airspeed  Rate 

(2) 

-0.06 

0.63** 

0.05 

36. 

Airspeed  Rate 

3 

-0.03 

-0.36 

-0.23 

37. 

Airspeed  Rate 

(4) 

0.14 

-0.05 

-0.06 

38. 

Time  (1) 

0.01 

-0.35 

-0.05 

39. 

Time  (2) 

0.35 

-0.62** 

0.10 

40. 

Time  (3) 

0.02 

0.32 

0.10 

41. 

Time  (4) 

-0.08 

-0.04 

0.00 

*  Significant  to  O.Ol  level 
♦♦Significant  to  0.05  level 
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These  and  other  differences  between  the  signs  and  agnitudes  of 
the  correlations  substantiate  the  questionable  degree  of  consistency 
between  the  two  IPs  insofar  as  ratings  are  concerned.  This  small  sample 
of  ratings,  particularly  for  IP-2,  cannot  be  expected  to  provide  a 
basis  for  proof-positive  statements  regarding  rating  consistency,  but 
it  certainly  warrants  raising  a  question  and  supports  the  contention  that 
IP  ratings  cannot  be  used  as  the  sole  basis  for  measurement  development. 

f.  Summary  and  Results  for  Lazy  8  Measurement 

Based  on  the  foregc'ng  analysis  of  lazy  8  data  from  three 
different  sources  (instructor  of  instructor-pilots,  standard  instructor 
pilots,  and  students),  the  following  recommendations  are  made  for 
measurement  of  this  maneuver: 

A  summary  error  measure  should  be  computed,  using  parameters  of 
roll,  pitch,  and  airspeed.  The  measure  used  in  this  study  is 


where  M.  and  C.  are  the  recorded  individual  measures  and  the  criteria 
for  pitch,  roll,  and  airspeed  sampled  at  the  four  points  of  local 
pitch  extremes. 

An  improved  error  measure  should  be  computed  and  evaluated  based  on 
a  continuous  comparison  between  roll/pitch  measures  and  criteria.  This 
can  be  accomplished  using  the  formula 

M  =  J  J  |a  -  c|  dr  dp 

-P  -r 

where  A  and  C  are  curves  for  actual  (recorded)  and  criterion  roll/pitch 
relationship,  p  is  pitch,  and  r  is  roll. 
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Debriefing  plots  showing  roll  vs  pitch  and  airspeed  should  be 
generated  and  annotated.  On  the  plots,  diagnostic  aids  should  be 
printed  in  the  form  of  individual  measures  and  comments.  Examples  of 
such  plots  are  shown  in  Appendix  XVI. 

Measures  should  be  validated  using  repeated  samples  per  student. 
Little  reliance,  except  for  initial  guidance,  should  be  placed  in 
correlations  between  IP  ratings  and  measures. 

The  criteria  computed  from  the  PIT  IP  data  appear  valid.  However 
a  larger  sample  of  data  is  required  to  ascertain  true  validity.  (This 
may  result  in  slight  alteration  of  the  parameter  criterion  values.) 

Environmental  conditions  (temperature  and  humidity)  that 
significantly  affect  aircraft  performance  should  be  considered  in  the 
development  of  quantitative  criteria. 

2.  BARREL  ROLL 

a.  Student  Data 

Forty-eight  student  performances  of  the  barrel  roll  were 
analyzed.  The  performances  were  rated  by  the  accompanying  IP  and  are 
distributed  across  skill  categories  as  shown  in  Figure  61.  Figures  62 
to  67  show  the  plots  of  mean  and  standard  deviations  for  the  47  measures. 
Correlations  with  subjective  ratings  are  provided  in  Table  XXII. 

Most  of  the  student  performances  (75%)  were  judged  in  the  "fair" 
category.  This  of  course  must  influence  our  interpretation  and  reliance 
upon  data  trends  across  skill  categories  as  well  as  the  correlations. 

So  although  some  insights  to  barrel  roll  measurement  can  be  determined 
using  the  existing  data,  tests  will  be  necessary  in  future  efforts 
using  (1)  a  better  data  sample  with  respect  to  each  skill  category 
and  (2)  more  samples  per  student. 
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TABLE  XXII 

CORRELATIONS  BETWEEN  MEASURES  AND  SUBJECTIVE  RATINGS 
FOR  STUDENT  BARREL  ROLLS 


Measure 

Correlation 

Coefficients 

All  (N=48) 

Left  (N=43) 

1. 

Symmetry  (1-4) 

-0.05 

-0.05 

2. 

Symmetry  (2-3) 

-0.15 

-0.16 

3. 

Symmetry  (Halves) 

-0.32* 

-0.32* 

4. 

Circle  1 

-0.27 

-0.27 

5. 

Circle  2 

-0.31* 

-0.31* 

6. 

Circle  All 

-0.31* 

-0.31* 

7. 

RR  Correlation  All 

0.24 

0.24 

8. 

PR  Correlation  All 

0.11 

0.14 

9. 

g  Correlation  All 

-0.04 

-0.06 

10. 

RR  Correlation  R>45 

-0.31* 

-0.33* 

11. 

PR  Correlation  R>45 

-0.01 

0.01 

12. 

g  Correlation  R  >  45 

-0.06 

-0.11 

13. 

Max  g  1 

0.17 

0.18 

14. 

Max  g  2 

0.19 

0.20 

15. 

Min  g 

0.18 

0.19 

16. 

Roll  Max  Pitch 

0.21 

0.22 

17. 

Roll  Min  Pitch 

0.15 

0.15 

18. 

Max  RR 

-0.13 

-0.15 

19. 

Max  PR 

0.11 

0.12 

20. 

Min  PR 

-0.04 

-0.04 

21. 

Time  (Total) 

-0.01 

-0.00 

22. 

Time  1 

-0.19 

-0.19 

23. 

Time  2 

0.18 

0.18 
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TABLE  XXII  (Concluded) 

CORRELATIONS  BETWEEN  MEASURES  AND  SUBJECTIVE  RATINGS 
FOR  STUDENT  BARREL  ROLLS 


Measure 

Correlation 

Coefficients 

All  (N=48) 

Left  (N=43) 

24. 

P 

(R  = 

10) 

0.22 

0.24 

25. 

P 

(R  = 

50) 

0.26 

0.27 

26. 

P 

(R  - 

90) 

0.28 

0.29 

27. 

P 

(R  = 

140) 

0.23 

0.24 

28. 

P 

(R  = 

180) 

0.24 

0.26 

29. 

P 

(R  = 

140) 

0.09 

0.09 

30. 

P 

(R  = 

90) 

0.04 

0.04 

31. 

P 

(R  = 

50) 

0.10 

0.10 

32. 

P 

(R  = 

10) 

0.22 

0.22 

33. 

A- 

ALT 

(R  = 

10) 

0.02 

0.03 

34. 

A- 

ALT 

(R  = 

60) 

0.04 

0.05 

35. 

A- 

ALT 

(R  = 

120) 

0.10 

0.10 

36. 

A- 

ALT 

(R  = 

180) 

0.11 

0.13 

37. 

A- 

ALT 

(R  = 

120) 

0.05 

0.07 

38. 

A- 

ALT 

(R  = 

60) 

-0.01 

0.00 

39. 

A- 

ALT 

(R  = 

10) 

-0.04 

-0.04 

40. 

A- 

ARSP 

(R  = 

10) 

-0.08 

-0.09 

41. 

A- 

ARSP 

(R  = 

60) 

-0.06 

-0.05 

42. 

A- 

ARSP 

(R  = 

120) 

-0.13 

-0.13 

43. 

A- 

ARSP 

(R  = 

180) 

-0.15 

-0.17 

44. 

A- 

ARSP 

(R  = 

120) 

-0.06 

-0.10 

45. 

A- 

ARSP 

(R  = 

60) 

-0.02 

-0.04 

46. 

A- 

ARSP 

(R  = 

10) 

0.14 

0.14 

♦Significant  to  0.05  level. 
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There  is  a  distinct  increase  in  variance  as  skill  ratings  decrease 
in  the  symmetry  measure  on  quarters  2  and  3.  No  significant  increase  is 
noted  for  quarters  1  and  4,  however  This  indicates  that  more  variance 
in  the  roll /pitch  relationship  is  exhibited  in  the  inverted  attitude, 
as  may  be  expected.  A  distinct  increase  in  variance  is  also  noted  for 
halves  1  and  2  as  skill  ratings  vary  from  fair  to  unsatisfactory. 

Circle  measures,  which  are  error  measures,  increase  in  value  as  well 
as  variance  as  skill  ratings  decrease.  From  this  data  and  from  the 
debriefing  plots,  it  is  postulated  that  the  circle  measure  will  prove 
to  be  one  of  the  best  single  indicies  of  performance  skill. 

Of  the  constancy  measures  on  roll  rate,  pitch  rate,  and  normal 
acceleration,  only  the  roll  rate  measure  for  |roll  |  >  45  appears 
significant  from  the  standpoint  of  significant  correlations.  However, 
the  plot  shows  that  as  skill  ratings  decrease,  the  correlation 
increases  toward  1.0,  indicating  less  variance  in  roll  rate  itself. 

This  is  the  opposite  from  that  which  was  expected  based  on  the  maneuver 
analy-'. ,  and  requires  further  investigation  in  future  efforts.  In 
addition,  variance  of  the  correlation  decreases  as  skill  ratings 
decrease,  though  one  would  expect  an  increase. 

Maximum  6  measures  show  a  slight  increase  as  skill  ratings  vary  from 
good  to  fair,  but  a  decrease  in  value  and  increase  in  variance  with 
reduction  to  unsatisfactory.  This  may  indicate  that  max.  G  measures 
may  discriminate  higher-skill  performances  better  than  lower-skill  ones; 
or  that  lower-skill  performance  patterns  are  typically  flatter  on  top  and 
dished-out  on  the  bottom,  resulting  in  much  less  normal  acceleration  on 
the  average.  Minimum  G  measures  show  a  decrease  from  fair  to 
unsatisfactory,  indicating  the  known  tendency  to  "get  light"  on  top 
when  unskilled  in  performance  of  this  maneuver. 
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Roll  at  maximum  pitch  is  approximately  60  to  62°  for  good 

performances  and  decreases  noticeably  as  skill  ratings  decrease  (with 

an  accompanying  increase  in  variance).  Th's  suggests  a  tendency  (ns 

skill  degrades)  to  pitch-up,  with  relatively  litcle  roll  .hen  roll 

to  the  inverted  position.  This  tendency  can  also  be  clearly  seen  in 

the  debriefing  plots  and  supports  the  validity  of  the  circle  measures, 

which  are  based  on  a  criterion  of  evenly  and  constantly  changing  roll 

and  pitch.  A  surprising  point  regarding  roll  at  maximum  pitch  ir  that 

theoretically  it  should  be  90°  to  maintain  a  constant  offset  angle  from 

the  reference  point.  However,  none  of  the  highly  skilled  performances, 

including  those  of  instructors,  exhibit  this.  It  appears  that  Ve 

requirement  for  a  constant  offset  angle  may  be  an  unrealistic  r  '^er  '.-n, 

both  from  the  standpoint  of  human  ability,  and  perhaps,  aircraf* 

0 

performance  ability. 

The  pitch  measures  at  various  values  of  roll  are  most  easily  ana.yzed 
via  the  plot  of  Figure  68.  The  unsatisfactory  performances  exhibit  a 
smaller  maximum  positive  pitch  angle  and  pitch  reduces  to  zero  before 
roll  has  reached  180°.  All  performances  exhibit  a  linear  as  opposed  lo 
a  smooth,  curvilinear  roll/pitch  relationship  in  the  second  quarter  of 
the  maneuver. 

Figures  69  and  70  show  similar  plots  for  altitude  and  airspeed 
excursions.  Little,  if  any,  relevant  measurement  information  can  b° 
expected  to  exist  in  these  measures. 

The  correlations  between  measures  and  subjective  ratings  (Table 
XXII)  indicate  only  four  significant  measures.  Although  any  number 
of  alternative  combinatory  measures  could  be  postulated,  the  data 
are  insufficient  to  permit  validation,  so  none  were  computed  for  the 
barrel  roll  in  this  study. 

8Plans  exist  to  test  the  realism  of  this  criterion  using  a  flight 
simulator.  We  attempted  to  test  it  in  the  aircraft,  but  despite 
specific  attempts  on  the  part  of  the  pilots,  they  were  unable  to  achieve 
90°  roll  at  maximum  pitch  and  still  complete  the  maneuver  satisfactorily 
in  all  other  respects. 
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b.  PIT  Instructor  Data 

Due  to  time  limitations,  barrel  roll  measures  were  not  computed 
for  the  PIT  Instructor  data.  However,  debriefing  plots  were  generated 
for  41  performances,  and  their  analysis  gives  additional  insights  to 
the  measurement  of  this  maneuver.  Several  plots  are  presented  in 
Appendix  XVIII,  along  with  the  transcribed  pilot  comments. 

It  can  be  seen,  in  viewing  the  plots,  that  the  roll/pitch 
relationship  is  very  relevant  to  measurement.  This  supports  the  trends 
indicated  in  the  student  data.  Many  of  the  conditions  described  in 
pilots'  comments  are  clearly  demonstrated  by  the  roll/pitch  plot,  e.g., 
dishing  out  on  the  bottom,  excessive  pitch  without  sufficient  roll, 
"flat"  portions  of  the  maneuver,  and  too  much  initial  back  pressure. 

c.  Summary 

Unfortunately,  not  nearly  enough  barrel  roll  data  was  collected 
to  form  supportable  recommendations  about  measurement  of  this  maneuver. 
The  major  deficit  is  successive  samples  per  student  needed  to  develop 
and  validate  measures.  Based  on  the  data  collected,  it  is  theorized 
that  the  following  measures  are  valid  and  should  be  investigated  further: 

1.  Roll/Pitch  Circle  Measures 

2.  Maximum  and  Minimum  G's 

3.  Constancy  of  Roll  Rate 

4.  Symmetry  Measures 

Further  studies  should  also  address  the  questions  raised  earlier 
regarding  roll  value  at  maximum  pitch,  and  whether  or  not  maintenance 
of  a  constant  offset  angle  is  a  realistic  criterion.  Further,  the 
uutnors  found  a  distinct  difference  between  instructors  in  their  method 
of  performing  the  barrel  roll  insofar  as  g  control  is  concerned. 
Realistic  criteria  on  g's  need  to  be  determined. 
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Measurement-wise,  it  is  obvious  that  less  was  accomplished  on  the 
barrel  roll  than  on  the  lazy  8.  This  was  due  primarily  to  lack  of 
sufficient  data;  but  contributing  factors  are  (1)  time  limitations 
on  the  study,  with  more  emphasis  having  been  placed  on  the  lazy  8,  and 
(2)  an  apparent  inconsistency  in  criteria  for  the  barrel  roll,  and 
subsequently,  a  great  necessity  for  computing  standards  (which  has  not 
yet  been  accomplished). 

3.  OTHER  MANEUVERS:  TYPICAL  DATA 

Some  representative  data  were  plotted  for  maneuvers  other  than  the 
lazy  8  and  barrel  roll.  This  data  will  be  used  to  support  follow-on 
studies  in  this  subject  area.  As  a  matter  of  interest  and  documentation, 
typical  plots  of  rollj pitch,  airspeed  and  altitude  are  presented  for 
several  of  these  other  maneuvers  in  Figures  71  through  76. 
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Figure  71.  Loop 
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Figure  74.  Maximum  Performance  Climbing  Turn 
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Figure  76.  Cuban 
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SECTION  VIII 

DISCUSSION  AND  ADDITIONAL  REMARKS 

It  is  fortunate  that  at  the  onset  of  this  program  the  authors  were  a 
little  naive  about  the  problems  and  difficulties  that  plague  collectors 
of  in-flight  data.  Otherwise,  that  which  has  resulted  in  an  extremely 
worthwhile  and  timely  effort  may  have  been  put  off  had  there  been  more 
realistic  original  estimates  of  the  time  and  level-of-effort  required  to 
complete  the  program.  As  it  turned  out,  only  30  to  40%  of  the  total 
effort  (manhours)  expended  was  actually  devoted  to  the  central  issue, 
e.g.,  development  of  measurement  techniques  for  two  representative 
maneuvers;  the  bulk  of  the  effort  was  devoted  to  establishing  the 
machinery,  so  to  speak,  for  data  collection,  reduction,  calibration, 
and  analysis.  In  a  way,  the  results  and  benefits  of  the  effort  are 
therefore  actually  greater  than  originally  anticipated,  because  in 
addition  to  accomplishing  the  major  goals  related  to  feasibility  of 
quantitative  measurement,  (i.e.,  knowing  what  to  do),  the  authors 
have  compiled  an  impressive  list  of  "what  not  to  do"  in  the  future. 

So  in  addition  to  providing  a  summary  of  central  results,  this  Section 
will  be  devoted  to  some  of  the  major  problems  encountered  (and  lessons 
learned)  in  accomplishing  an  effort  of  this  type. 

1 .  PROBLEMS 

It  is  not  easy  to  obtain  good  in-flight  performance  data  and  reduce  it 
to  a  form  suitable  for  analysis.  Recognition  of  this,  and  provision  for 
sufficient  personnel  to  handle  problems  as  they  arise,  is  necessary  to  a 
successful  conduct  of  related  studies.  In  the  study  being  reported,  the 
limited  availability  of  equipment  and  support  personnel  made  it  necessary 
to  obtain  the  needed  support  from  two  different  data  processing 
installations.  This  complicated  the  already  difficult  job  by  requiring 
inter-installation  coordination  and  by  creating  additional  problems 
through  the  use  of  different  tape  units  for  producing  and  reading  data. 

In  addition,  control  of  personnel  was  not  possible,  and  several 
different  programmers  were  assigned  to  the  program  over  its  tenure. 
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This  required  almost  continual  education  of  these  new  people  regarding 
data  formats  and  program  objectives.  Finally,  no  control  existed  over 
the  utilization  of  data  processing  equipment,  and  turn  around  time  from 
flight  to  calibrated  data  was  considerably  longer  than  it  should  have 
been  for  efficient  operation  due  to  higher  priority  programs  competing 
for  use  of  the  equipment. 

The  in-flight  data  acquisition  equipment  represented  no  exception  to 
"Murphy's  Law,"  particularly  because  it  was  largely  (off-the-shelf) 
used  equipment.  Partway  through  the  program  problems  arose  with  the 
heading  transducer  that  were  never  completely  rectified  despite  several 
recalibrations.  (Later,  it  was  determined  that  a  new  transducer  is 
required.)  Other  equipment  malfunctions  occurred  from  time  to  time, 
seriously  delaying  data  collection  schedules  and  validating  the 
importance  and  necessity  of  establishing  a  rigorous  periodic  recalibration 
and  preventive  maintenance  program  for  the  airborne  equipment.  This 
would  hopefully  minimize  the  requirement  for  the  unscheduled,  on-call 
type  of  maintenance  that  upsets  schedules. 

Operational  problems  also  confounded  the  problem.  Despite  planning- 
precautions,  flight  line  personnel  often  failed  to  clean  the  recorder 
heads  as  required,  and  data  from  several  sorties  were  lost.  This 
occurred  most  often  during  the  last  several  weeks  of  off -site  data 
collection  and  was  in  part  the  reason  why  sufficient  validation  data  was 
not  successfully  collected.  Another  operational  problem  regarded  in¬ 
flight  use  of  the  recorder  through  cockpit  controls.  Each  instructor 
was  briefed  on  recorder  operation,  but  evidently  the  briefings  were  not 
thorough  enough.  On  several  successive  sorties,  the  participating  IP 
turned  the  recorder  off  between  maneuvers,  and  this  resulted  in  losing 
some  data  at  the  end  or  beginning  of  maneuvers.  It  also  caused  "glitches" 
in  the  data  at  the  time  the  recorder  was  turned  off  or  on  and  destroyed 
the  continuity  of  the  time-count. 
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It  is  also  important,  in  projecting  schedules  for  studies  like  this, 
to  consider  not  only  anticipated  aircraft  maintenance  downtime,  but 
special  requirements  for  modifications  and  inspections.  For  example, 
data  collection  was  interrupted  on  two  separate  occasions  for  flap-hinge 
mods  ar.d  wing  spar  inspections.  These  sound  innocent  enough,  but  in 
the  case  of  this  study  the  aircraft  was  bailed  to  Flight  Test  and  they, 
therefore,  accomplished  the  mods.  Scheduling  of  hangar  space  and 
personnel  to  accomplish  the  work  was  perhaps  more  of  a  problem  than  it 
would  be  with  a  regular  training  aircraft  in  the  ATC  fleet. 

For  student  data  collection,  the  arrangement  with  ATC  included 
assurance  that  normal  schedules  and  curricula  would  not  be  interfered 
with.  This  made  collection  of  large  quantities  of  data  per  student 
per  maneuver  difficult. 

The  effort  was  conducted  100%  in-house  and  necessarily  attempts 
w?re  made  to  minimize  any  direct  costs.  At  the  onset  of  the  program, 
some  surplus  recorders  were  obtained.  These  proved  unusable.  The 
recorder  and  instrumentation  gear  finally  installed  was  used  equipment, 
not  in  itself  bad,  but  necessitating  some  additional  test  and  parts 
replacement  early  in  the  program. 

The  effort  was  largely  prototype  and  investigatory  in  nature  and 
considerable  effort  was  expended  on  alternative  solutions  to  problems  as 
they  occurred: 

2.  EULER  ANGLES  COMPUTATION 

One  small  side-effort  concerned  the  computation  of  Euler  angles  from 
recorded  rates.  Th’s  was  investigated  for  three  reasons:  (1)  It 
would  provide  an  additional  check  on  the  relative  accuracies  with  which 
rates  and  angles  are  recorded,  (2)  It  would  allow  angles  through  all 
attitudes  to  be  generated  without  necessitating  all-altitude  roll  and 
pitch  transducers,  (3)  It  would  provide  the  only  good  test  conceivable 
on  the  accuracy  of  rate  information.  Programs  were  written  to  compute 
angles  from  rates.  Results  showed  that  recorded  rate  information  was 
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too  noisy  to  produce  good  results  and  the  effort  was  abandoned  to  the 
priority  of  other  problems. 

3.  MODELING  OF  NORMATIVE  DATA 

Another  side-effort  concerned  taking  a  closer  look  at  computation 
of  norms  or  standards.  Although  used  to  some  extent  in  this  study, 
mean-performances  are  not  believed  to  be  infallible  representations  of 
standards,  any  more  than  the  mean  is  always  a  good  representation  of 
any  data. 

In  studying  the  formal  description  and  ATC  criteria  for  the  lazy  8 
maneuver,  the  idea  occurred  that  functions  representing  both  roll  and 
pitch  versus  degrees-of-turn  may  be  easily  approximated  using 
trigonometric  functions.  For  example  roll  angle  increases  to  a  maximum 
at  turn  =  90°,  decreases  to  zero  at  turn  =  180°;  then  repeats  this 
pattern.  In  simplest  form,  we  could  represent  this  motion  by  a  sine 
wave  multiplied  by  the  maximum  roll  angle  attained  in  the  maneuver 
(80  -  9r/ ) . 

Pitch  behaves  similarly  but  has  an  amplitude  equal  to  the  largest 
pitch  angle  attained  in  the  maneuver  and  a  frequency  equal  to  twice  that 
of  the  r  '1  function. 

An  harmonic  analysis  of  a  function  is  a  truncated  Fourier  Series 
approximation  to  the  function  defined  at  discrete,  equidistant  points 
over  a  finite  interval.  The  function  approximation  is  of  the  form 

F{x)  =  O  +  £  [on  Co*(nx)  +  bn  Sin(nx)]  . 

n=i  L  J 

In  addition  to  providing  a  model  of  performances,  the  function's 
coefficients  (a^  and  b..)  could  provide  useful  measures.  For  instance, 
in  order  for  all  a.,  coefficients  to  be  zero,  two  characteristics  must  be 
present  in  the  data:  (1)  perfect  symmetry  and  (2)  zero  pitch  at  0  and 
90°  turn  points.  The  farther  from  zero  the  a^  are,  the  farther  the 
data  are  from  having  the  above  two  characteristics. 
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A  program  was  written  to  accept  as  inputs  the  numt  F  perfu  ,ncc-s 
to  be  harmonically  analyzed,  the  number  of  harmonics  to  be  used  in  the 
model,  and  the  recorded  data.  It  then  printed  out  the  derived  Fourier 
coefficients  and  the  data  generated  by  stepping  the  model  0  to  lbl) 
turn  by  increments  of  5°.  Results  indicate  that  this  is  an  extremely 
promising  approach  to  modeling  the  data,  result1' no  ,ri  much  rr>re 
realistic  and  useful  standards  than  can  be  represented  by  the  mea  . 

4.  DEBRIEFING  PLOTS  ANALYSIS 

A  respectable  amount  of  time  was  devoted  to  conceptual  analysis  of 
the  debriefing  plots.  After  becoming  familiar  with  the  plots  and 
learning  to  read  them,  forty  of  the  plots  were  shuffled  and  attempt- 
were  then  made  by  the  authors  to  judge  from  the  plots  alone  whether  <.acn 
performance  was  E,  G,  F,  or  U.  Out  of  40  performances,  only  8  v-re 
classified  incorrectly.  This  was  an  insignificant  test,  done  as  much 
out  of  idle  curjosity  as  for  any  other  reason,  and  not  exactly 
uncontaminated  in. design.  However,  it  convinces  tha  authors  that  a 
properly  indoctrinated  instructor  could  evaluate  performances  using 
debriefing  plots  alone  and  do  the  job  at  least  as  well  and  much  more 
diagnostically  than  he  can  on-site  (in-flight). 

Further  experimentation  was  done  in  this  area  by  devising  plastic 
overlays  for  the  plots  on  which  wera  sketched  standard  profiles  +l<r. 

This  is  helpful  in  interpreting  the  performances  and  diagnosinq  errors. 
The  approach  of  using  overlays  instead  of  plotting  the  performances 
against  standards  would  be  useful  in  analyzing  the  data  and  debriefing 
the  student  based  on  his  deviation  from  norms  as  well  as  his  deviation 
from  standard  criteria. 

5.  MEASUREMENT  APPROACH 

In  this  effort,  the  approach  to  the  development  of  performance 
measures  was  analytic"  in  that  it  involved  and  required  considerable 
desk-analysis  of  both  the  criteria  (ATC)  and  the  recorded  data. 

Maneuver  analyses  were  performed,  measures  were  postulated,  results 
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were  examined,  a  new  set  of  measures  was  postulated  based  on  the  initial 
results,  and  finally,  these  measures  were  applied  to  a  broad  spectrum 
of  student  and  instructor  performances.  Analysis  of  the  final  results 
included  investigating  correlations  between  the  measures  and  subjective 
ratings  and  then,  to  a  more  limited  extent,  examining  the  trends  of 
measures  across  individual  student  performance. 

The  result  of  this  effort  was  that  a  good  set  of  prototype  measures 
for  the  lazy  8  was  developed,  and  a  similar  set  for  the  barrel  roll. 
Unfortunately,  the  measures  for  the  barrel  role  were  less  defensible 
tnan  were  those  for  the  lazy  8,  because  of  insufficient  data.  The 
validation  of  these  measures  was  somewhat  hampered  by  such  factors  as 
lack  of  IP  performance  standardization,  questionable  "text  book" 
criteria  for  the  two  maneuvers,  lack  of  IP  rating  standardization,  and 
the  necessity  of  using  within-subject  sampling  as  a  basis  for  both  the 
development  and  validation  of  measures. 

The  approach  itself  was  time-consuming  to  apply  due  to  the  need  for 
continual  interaction  with  large  quantities  of  data.  It  is  a  workable 
approach  given  proper  manpower  support  and  it  enjoys  an  affinity  with 
logical  human  performance  aspects  of  the  maneuvers  that  is  perhaps  lacking 
in  other  more  highly  automated  approaches.  It  lacks  the  desirable 
characteristics  of  requiring  less  effort  to  pursue  the  second  time  than 
the  first,  because  for  each  maneuver  examined,  new  and  different 
problems  arise  and  each  must  be  treated  individually. 

It  is  appropriate  at  this  point,  to  remark  that  throughout  the 
duration  of  this  program,  another  entirely  different  approach  to 
developing  measurement  methods  was  pursued  using  some  of  the  seme  data. 

The  alternate  approach  lies  at  the  opposite  end  of  the  spectrum  from 
this  analytic  approach  with  respect  to  automation  and  global  applicability. 
To  pursue  the  alternate  approach,  certain  functions  of  the  data  had  to 
be  determined  and  computed.  Identification  of  these  functions  was 
enhanced  through  results,  as  they  unfolded,  from  the  analytic  approach. 
Thus  the  two  approaches  were  largely  conducted  in  a  complementary 
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fashion,  even  though  the  results  from  each  are  reported  independently. 
References  3  and  5  document  the  alternate  approach. 

After  having  applied  this  "analytic"  approach  and,  concurrently, 
a  more  automated  approach  (which  is  based  on  adaptive  modeling),  the 
concensus  is  that  neither  suffices  independently  -  at  least  now.  The 
analytic  approach,  although  workable,  is  simply  too  time-consuming  to 
be  effective  in,  say,  developing  measures  for  ar,  entire  training 
curriculum.  Also,  it  suffers  from  a  standardization  standpoint  in  that 
one  is  never  really  sure  he  is  finished  when  using  it.  This  is  in  turn 
due  to  a  fundamental  weakness  of  the  approach  in  that  the  types  of 
measures  it  addresses  represent  only  a  subset  of  all  possible  measures. 
(Conversely,  the  alternate  approach.  References  3  and  5,  addresses  an 
extremely  broad  spectrum  of  measures.) 

The  analytic  approach  has  several  noteworthy  merits,  the  main  one 
of  which  is  the  in-depth  understanding  one  must  obtain  of  the  maneuver 
and  related  performance  techniques,  and  subsequently  the  application  of 
logic  and  judgment  to  the  problem  that  would  be  possible  only  through 
the  utmost  in  programming  sophistication  on  an  automated  basis. 

The  point  to  be  made  is  that  the  analytic  approach  is  too  "manual" 
to  be  efficient  on  a  large  scale  application  and  does  not  address  all 
types  of  measures.  More  automated  approaches  take  the  labor  out  of  the 
job,  are  widely  applicable,  and  address  a  broad  spectrum  of  measures, 
but  they  require  an  element  of  human  judgment  to  be  practical.  A  blend 
of  the  two  types  of  approaches  appears  ideal. 

6.  MEASUREMENT  RESULTS 

For  the  lazy  8,  measurement  can  be  accomplished  using  roll,  pitch, 
and  airspeed.  This  was  demonstrated  in  this  study  through  the  develop¬ 
ment  of  a  simple  error  measure,  with  criteria  consisting  of  values  for 
the  variables  computed  from  skilled  pilot's  data.  An  improvement  on 
this  error  measure  is  believed  possible  through  application  of  continuous 
rather  than  discrete  error  computations  as  discussed  in  Section  VII. 
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The  time  and  scope  of  this  effort  did  not  permit  further  pursuit  of  this 
idea,  however. 

The  above  statements  are  made  without  the  essential  justification  that 
good  validation,  beyond  the  content  validity  that  existed,  would  provide. 
When  accomDlished,  validation  should  include  the  previously  discussed  tests 
based  on  wi thin-subject  sampling.  Concurrent  validation  using  Instructor 
ratings,  if  conducted,  should  be  pursued  as  a  necessary  (not  sufficient) 
test,  and  then  only  with  the  cautions  previously  identified. 

The  barrel  roll  measures  could  not  te  developed  to  the  extent  they 
were  for  the  lazy  8  due  to  lack  of  sufficient  data.  From  the 
information  examined,  however,  it  appears  that  roll,  pitch,  normal 
acceleration,  and  roll-rate  will  provide  the  necessary  data  base.  Roll 
and  pitch  are  not  relevant  as  single-variable  measures;  rather,  it  is 
their  relationship  that  forms  the  essential  measure.  The  nature  of  a 
criterion  relationship  could  not  be  well  defined;  according  to  published 
criteria,  it  appears  to  be  circular,  but  the  actual  data  of  skilled 
pilots  does  not  support  the  validity  or  realism  of  this  criterion.  To 
a  greater  extent  than  in  the  lazy  8,  standards  must  be  determined  for 
this  maneuver.  Roll  rate  measures  should  reflect  the  constancy  of  this 
value  after  the  maneuver  is  underway.  Measures  on  g’s  should  reflect 
maximum  excursions,  but  here  again  criteria  are  lacking,  and  little 
standardization  among  IPs  was  found. 

From  a  diagnostic  standpoint,  the  debriefing  charts  would  form  an 
appropriate  media  for  conveying  both  measures  and  diagnostic  comments  to 
the  instructor  or  student.  This  would  provide  the  necessary  information 
on  not  just  how  well  the  student  performed,  but  why  and  where  he 
performed  poorly. 

It  is  compelling  to  bring  out  one  final  idea  relating  to  measurement. 
This  idea  is  not  original  with  the  authors,  and  it  was  not  pursued  in 
this  study,  but  it  was  so  obvious  in  this  study  and  is  so  central  to  any 
final  measurement  design  that  this  discussion  would  be  incomplete  without 
mentioning  it.  The  idea  is  that  measurement  of  individual  performances 
of  a  maneuver  cannot  effectively  be  considered  independently,  even  1* 
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one  is  only  concerned  with  one  performance  at  the  time.  Rather,  the 
distribution  of  measures  on  successive  trials,  and  if  one  desires,  the 
subsequent  probability  of  successful  performance  based  on  that  distribution 
is  the  important  consideration.  Therefore,  measures  themselves  should 
ultimately  be  expressed  in  terms  of  the  resulting  distribution.  This 
automatically  takes  into  account  both  the  measure(s)  achieved  and  inter¬ 
performance  variance,  both  of  which  are  considered  relevant  to  pilot 
evaluation. 
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CALIBRATION  BLOCK  DIAGRAMS  FOR 
RECORDED  FLIGHT  DATA 


Preceding  page  blank 


247 


AFHRL-TR-72-6 


Parameter:  Heading 


Units:  Degrees 


Parameter 

Input 

Transducer 

Output 

Parameter 

Input 

Transducer 

Output 

360 

0 

170 

2.730 

350 

0  .128 

160 

2.879 

340 

0  .281 

150 

3.017 

330 

0  .404 

140 

3.155 

320 

0  .563 

130 

3.324 

310 

0  .701 

120 

3.468 

300 

0  .840 

no 

3.616 

290 

0  .988 

100 

3.744 

280 

1.137 

90 

3.913 

270 

1.280 

80 

4.001 

260 

1.424 

70 

4.170 

250 

1.567 

60 

4.246 

240 

1.711 

50 

4.282 

230 

1.864 

40 

4.308 

220 

2.003 

30 

4.334 

210 

2.151 

20 

4.359 

200 

2.305 

190 

2.448 

180 

2.581 

CqMbreflon  Block  Ptotrom 
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Parameter:  Altitud 


Units:  Feet  (XI 000 ) 


Parameter 

Input 

Transducer 

Output 

0.89 

0.133 

1.0 

0.163 

1.5 

0.225 

2.0 

0.292 

2.5 

0.379 

3.0 

0.450 

4.0 

0.647 

6.0 

0.896 

8.0 

1.206 

10.0 

1.480 

12.0 

1.787 

14.0 

2.100 

16.0 

2.397 

18.0 

2.689 

20.0 

3.002 

22.0 

3.309 

24.0 

3.596 

26.0 

3.908 

Parameter 

Transducer 

Input 

Output 

Calibration  Block  Diagram 


SOURCE 
Altitude 
Test  Set 


TRANSDUCER 
A1  ti tude 
Model  7000 


CONDITIONING 


EXCITATION 
+5  VOC 


INSTRUMENT 
System  Read-Out 
Light  Panel 
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Parameter:  Airspeed _  Units:  Knots 


Parameter 

Input 

Transducer 

Output 

Parameter 

Input 

Transducer 

Output 

0 

0.491 

60 

0.7836 

70 

0.9065 

80 

1.091 

90 

1.152 

100 

1.310 

120 

1.585 

140 

1.864 

160 

2.165 

180 

2.438 

200 

2.723 

220 

3.006 

240 

3.267 

260 

3.529 

280 

3.790 

300 

4.025 

Cotlfarotlon  Bloch  Diogrom 
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Parameter 

Input 

Transducer 

Output 

Parameter 

Input 

Transducer 

Output 

180 

5.00 

-  10 

2.36 

120 

4.27 

-  20 

2.21 

110 

4.12 

-  30 

2.07 

100 

3.98 

-  40 

1.93 

90 

3.83 

-  50 

1.77 

80 

3.68 

-  60 

1.63 

70 

3.53 

-  70 

1.48 

60 

3.39 

-  80 

1.34 

50 

3.25 

-  90 

1.19 

40 

3.10 

-100 

1.05 

30 

2.95 

-no 

0.91 

20 

2.79 

-120 

0.84 

10 

2.65 

-180 

0 

J _ 1_ 

2.50 

CoHbrotlon  Block  Dlagrom 


EXCITATION 


INSTRUMENT 


.  ~  I  1\  “  / 


meter:  Ro.  i  Rat,. _ _  j  ■ .  Ls :  2earees/fa('  id 


Parameter 

Input 

Transducer 

Output 

Parameter 

Input 

Transduce* 

itput 

180 

4.66 

-  20 

9  495 

160 

4.13 

-  40 

-i.n 

140 

3.595 

-  60 

-l  .r 

120  ' 

3.07 

-  80 

-2.03 

100 

2.545 

-100 

-2.545 

80 

2.03 

-120 

-3.03 

60 

1.51 

-140 

-3.60 

40 

1.0 

-160 

-4.126 

20 

0.49 

-180 

-4. fab 

0 

0 

Calibration  Block  Diagram 


Rate  Table 
No.  722 


0.2  mf  d 
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Parameter:  Yaw  Rate _ _  Units:  Degrees/Second 


Parameter 

Input 

Transducer 

Output 

Parameter 

Input 

Transducer 

Output 

70 

4.75 

60 

4.135 

50 

3.501 

40 

2.84 

30 

2.14 

20 

1 .425 

10 

.705 

0 

0 

-10 

-0.73 

-20 

-1.45 

-30 

-2.165 

-40 

-2.87 

-50 

-3.54 

-60 

-4.17 

-70 

-4.78 

Colibrotlon  Block  Dloqrom 
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Parameter:  Longitudinal  Stick  Position 


Units:  Degrees 


Calibration  Block  Diagram 
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Parameter:  Rudder  Position 


Parameter 

Input 


24 

22 

18 

14 

10 

8 

6 

4 

2 

0 


Transducer 

Output 


0.07 

0.4 

0.8 

1.18 

1.57 

1.78 

2.00 

2.17 

2.40 

2.54 


Units:  Degrees 


Parameter 

Input 


-  2 

-  4 

-  6 
-  8 
-10 
-14 
-18 
-22 
-24 


Transducer 

Output 


2.80 

3.00 

3.20 

3.40 
3.60 
4.00 

4.40 
4.80 
5.00 


CoUtorotlon  Block 
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Parameter:  Engine  RPM _  Units:  Percent 


Parameter 

Input 

Transducer 

Output 

$ 

Parameter 

Input 

Transducer 

Output 

14.28 

0.7 

28.57 

1.4 

L 

42.85 

2.11 

E 

57.14 

2.82 

F 

71.42 

3.55 

IK 

85.71 

4.28 

m 

100. 

5.00 

■ 

14.28 

0.56 

28.57 

1.12 

n 

42.85 

1.69 

a 

57.14 

2.27 

G 

71.42 

2.88 

H 

85.71 

3.45 

D 

100. 

4.00 

1 

i 

Calibrotlon  Slocfc  Dtoicow 


CONDITIONING 


EXCITATION 


INSTRUMENT 
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Parameter 

Input 


Transducer 

Output 
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Parameter:  Flap  Position _  Units:  Percent 


Parameter 

Input 

Transducer 

Output 

1 

Parameter 

Input 

Transducer 

Output 

0 

4.06 

■ 

20 

3.76 

If 

40 

2.85 

n 

60 

1.90 

80 

1.00 

100 

0.11 

1 

Calibration  Block  Diatom 


CONDITIONING 
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APPENDIX  II 

ILLUSTRATION  OF  INITIAL  PRINT-OUT  FORMAT 


Note:  Th^ee  pages  of  computer  print  out 

were  required  to  represent  approximately 
50  seconds  of  data. 
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SOFTWARE  FOR  DATA  CALIBRATION 
AND 

INITIAL  PRINT-OUT 
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SJOB 

SSE1UP  A(l) 

I p JOB  GUTHRE 
IRFTC  T37DAT 
SSFTIJP  All) 


0.5.5000 

X1B95.X1856.-9 

MAP 

M94.XR7.NODECK 
RFAO  THF  RAW 


69-026. GUTHRIE.  ROOM 
UNIT  14  22  OCT  70 


209  BLOCK 
FLIGHT  2-8 


DATA  136  BIT  WORDS  WRITTFN  AT  556  DENSITY 

MANY  AS  9 
WRITE  OUT  THF  RAW 


IN  NON  DCS  BLOCKING)  FROM  TAPF  X1895  AND  SKIP  AS 
REDUNDANT  RECORDS.  ACCOMPLISH  DCS  BLOCKING  AND 
DATA  AT  DENSITY  800  ON  TAPF  X1856  AND  RFWIND. 
DIMFNSION  AI410) 

INTEGER  RECORD 

;  READ  AND  COUNT  THE  RECORDS  WRITTEN  ON  TAPE  X1856. 
RECOPD=0 

C  THE  SYMBOLICS  FOR  SIO.  1  CALL  READ)  AND  UNITS  ARE  IN 

1  CALL  READ  (lA.A.K.N) 

RECORD=RECORD+l 

IF  ( MOD ( RECORD .  100  )  • NE . 0 )  GO  TO  A 
PRINT  5.RFCORD 
5  FORMAT  ( 8H  RFC0RD*,I6l 

A  N=N+1 

GO  TO  I  1.2.3)  .N 

C  CALL  FXEM  GIVES  AN  ERROR  TRACE  AND  RETURNS  CONTROL 
C  SYMBOLICS  NOT  INCLUDED 

3  CALL  FXFM 

2  RECORD*RECORD-t 
PRINT  5, RECORD 
STOP 

END 

SlRLDR  SIO.  25  SEP  67 

4TFXT  SIO. 

*N  '*,*71*71*7-0  '75  74  •  '549  7 

*N97P**7Xt7v*X- )6  E  $76'4  2'  *7' 

*Nfl( )**7V*7V*7  4  2'  X'  ••  "ft  ' 69G 
7EI0  G7Z76  5  774  4 
76  G6 ) 76 ' 4  2'  )  ' 

75 ' 7 ' -  0  5  7- 

7'++  5597* 

9  8 


THE  MAIN  DECK 


TO  THE  SYSTEM 


*N96< I ( X(*X<  *7 
*N7G ) ( *7  <  *7X*7 
*  N • RX )*7**7X*7 


*N • NX  I *7 ( *7( *7  - 

6,5  7- 

»T • **  <  *77 

*) 

SCDICT 

SIO. 

*N  X2*84  1 '*  )P84  »)P  U 

*19Z*  < 1 

1**-  I )G- 

SDKEND 

SIO. 

SlRLDR 

UNITS 

SFILE 

UNITS 

IJNIT1A' 

SFILE 

UNITS 

UN  I T 15 ' 

SFILE 

UNITS 

UNI T 16' 

SFILE 

UNITS 

UN  I T 1 7' 

SFILE 

UNITS 

UN  IT  18' 

SFD'CT 

UNITS 

*J  I  I  '< 

42*  * ( 7PPPPPP72 

*  49P7PP2P  *  I 6PPPPPP 

STFXT 

UNITS 

*T  =*7*XG 

I  H 

SCDIC1 

UNITS 

*V  *1  s 

4  l'*(P 

4  X.' 

SDKFND 

UNITS 

* 

END  OF  FILE  CARD 

•74074875974956976  5  976776  4M7'6  7  • 
,  7-  76776  74  (  5M  •  44  7  •  144"  U5M'76' 

05  Y5  I G7  757 ' 69 )  07696  Y)7  75»7'0 
99M ' 5  7*  14  79M ' 5  7-  76776  447'  )4M' 

)G7  757 ' 69 )  0)  07695  Y)7 
"  X7494M 776  0677577*0  5 
X  74-02X83*  25690 


•  "6 
76776 
0 


' 69G  05 
76 ' 4  2' 
559449* 


•|PP  S'*(P  U'**<  X  *  <  * )  -6  P*)-  I)*-  (*P-  Id- 


18  SFP  69 

.All)  , INPUT. B IN, BLK=410 
,A(2)  .INOUT ,B 1 N ,BLK  =  1 080 


* ( t  pppppp 72P  * ( ' PPPPPP72P  *('PPPPPP 


9X. 


8  X  • 


9X.  I 


SIO, 0000 
SIO. 0001 
SIO. 0002 
SIO. 0003 
SIO. 0004 
510.0005 
SID. 0006 
SIO. 0007 
SIO. 0008 
SIO. 0009 
SIO. 0010 
SIO. 0011 
SIO. 0012 
SIO. 0013 
UNITSOOO 
UNITS001 
UNITS002 
UNITS003 
UNITS004 
UNITS005 
UNITS006 
llN  I  T SOO  7 
IJNITS008 


UN  ITS009 
UNITS010 
UMITS011 
UN  I  TSOI  2 
UNITS01S 
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1  JOB 

isriuP 

SSFTtJP 

*SFTUP 

ilBFTC 

C 

c 
c 
c 
c 
c 
c 
r 
c 
c 


0  »  S  »  5000  69-026  GUTHRIE  ROOM  ?09  START 

A  <  1  )  X 1 856 , NOR ! NO  UNIT  1 A  15  OCT  70  FLIGHT  2-5 
A  <  2  1  X  1 9 1 A  UNIT  15 
A  ( 3 )  TAPF  ON  I T  16 

T37DAT  MqA»XR7  .NODFCK  _ 

EACH  FOOT  OF  MAGNETIC  TAPF  AT  800  DENSITY  WILL  HOLD  1300  36BIT 

FLOATING  POINT  WORDS  INCLUDING  DCS  BLOCKING.  1700  RECORDS  REOUlRF 
1805  FFE'T  OF  TAPF.  1  700*  f  (  1  2*  ?8  )  +  (1  20*9  )>  /  1  ’00 

THE  WORD  RECORD  WHEN  USED  IN  REFERENCE  TO  UNITS  15  AND  16  MFANS 

1  ,  1  70 )  , J  =  1  ,5  )  PLUS  (  ( A 2A < I  . J)  . I  =  1  » 1? )  » J= 1 ,75  )  =1380  VOS 


( ( A?AO( I . J» . ]■ 
4SFTIIP  All)  X  1  856 
tSFTUP  A ( 2 )  X 1 9 1 A 
CALIBRATFD  DATA 
iSETUP  A  I  3 )  TAPF 


DCS  PLOCKFn  RAW 
TAPF  TO  CONTAIN 


DATA 

THE  FIRST 


1700  RECORDS  OF 


IF  THERE  ARE  MORE  THAN  1700  RECORDS  AN  ADDITIONAL 
TAPE  IS  REQUIRED  ON  UNIT  16 

DIMENSION  A(A10 ) »M( ICO) .WORDS! 100) *TAPFSI? ) 

COMMON  /A1 /  N 1 2 .N 120 .RECORD, I  UN  1 T .N, TAPE , I MP I  100) , JCOL I  100 ) , 
IXARRAYIM  ,18)  . Y  A  RR A Y I  5 1  . Ift)  .JCALI100), I2A.I2AO 
COMMON  /A2/  J1  » A2A ( 2A ,25 )  , A2A0! 2 AO  ,9 ) .CYCLE .SET 
INTEGER  RECORD , FF T 
NAMFLIST  /NAM  1 /  ITAPE.IP.IPD 
READ  (8,1)  TAPE 

|APF  tHF  RFFL  NUMPFR  to  be  MOUNTED  ON  A(l)  UNIT  1A 
rORMAT  (Aft) 

RF  AD  (S.NAM1) 

JI516=15 
SET  =  0 
CYCLE* 0.0 
RECORD=0 
J  1  =0 
I  UN  I T= 1 A 

READ  AND  WRITE  INTEGER  CONTROL  VECTORS 
JCOL (100)  CONTAINS  THE  COLUMN  NUMBER  (J)  OF  X ARRAY  I NP » J )  AND 

(MP.J) 

RFAD  IF,?)  ( JCOL( T ) ♦ 1=1 , 100) 

FORMAT  ( ?0  I A ) 

INP(IOO)  CONTAINS  THE  NUMBER  OT  POINTS  ( NP )  OF  xARRAY(NP.J)  AND 
YARRAY(NP.J) 

READ  (5,2)  (  1NPU  ).  1  =  1.100) 

JCAL(IOO)  CONTAINS  THE  COLUMN  NUMBER  OF  THE  CALIBRATED  DATA  TO  BE 
STORED  IN  A 7A0 ( I , J )  AND  A?A(I.J-6) 

READ  (8,?)  ( JCALI I ) » I =1 , 100) 

wRITF  (6.971  (J^OLI  II  ,1=1  ,1001 
97  FORMAT  ( 12HOJCOL  VFCT0R/1X/I IX. 2016)) 

WRITE  (6,98)  (  INP(  !)  .1  =  1.100) 

9R  FORMAT  I 11H0INP  VFCT0R/1X/(1X,?016) ) 

WRTTF  (6,99)  (JCALI  I)  »T  =  1 .100) 
qq  FORMAT  (12H0JCAL  VECTOR/ 1 X/ ( 1 X  * 20  1 6 ) ) 

C  TFAD  AND  WRITE  THE  CALIBRATION  DATA 
DO  3  J= 1 , 1 8 


MATNOO 
M A I  NO  1 
MAINO? 

MAINOA 
MAINO 5 
MAIN06 

MAIN07 
MA  IMOB 
MAIN09 
MA IN  10 
MAIN11 
MAIN12 
MAIN13 
M A  INI A 

Y ARRA YM A I N 1 5 
MAIM16 
MAIN1  7 
MAIN1R 
M  A I N 1 9 
MAIN20 
MA1N21 
MA1N22 
MAIN23 
M  A I M  2  A 
MAIN25 
MAIN26 
M A IN77 
M  A  I N  78 
MAIN29 
M  A  I N  30 

M  A  I  N  3 1 
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REAP  (  )  LARFLX.LABFLY.NP  MAIN32 

FORMAT  ( A6.5X,A6,5X.I2)  MAIN33 

RFAD  (5,5)  ( XARRAYI I . J) . I =1 ,  NP >  MAIN34 

RFAD  (3.51  (YARRAYI I .J). 1=1* NP)  MAIN35 

FORMAT  (10F8.3)  MAIN36 

WRITF  (6.49)  LARFI.X.l  APFLY.NP  MAIN37 

>  format  ( 1HO, A6,5X.A6,5X , 12)  MAIN3R 

WRITE  (5,50)  (XARRAYI  1  ,J)  .1=1. NP)  MAIN39 

WRITF  (6.50)  ( YARRAYI 1 .J)  .1  =  1 ,NP)  WAIN40 

)  FORMAT  ( lH0,10F12.3/< IX. 10F12.3) )  M A I N41 

FONT INUF  MAIN42 

PRINT  13.J1516  MAIN43 

1  FORMAT  (6H  UNIT-, 14)  MAIN44 

N 12=0  MA 1 N 45 

N  1  70=0  MAIN46 

CALL  CYCLFS  (A, M, WORDS)  MAIN47 

N 1 2= 1 2  M  A  I N A 0 

N 1 20  =  1 70  MAINA9 

CALI  CYCLFS  ( A .WORDS )  MAJN50 

D1FFERFNTI ATF  VERTICAL  VFLOC I T Y  =  A2A (  I  ,  2  1  )  ,  TURN  R ATF  =  A2A ( I  ,22 ) , ST  I CK 
RATF  LONG  I  TDD  INAL  =  A  240  (  1,7)  .STICK  RATT  LATERAL  =  A2A0  (  I  ,8)  .RtjDDFR  R  ATF 
=A2AO ( 1 ,9) 

DO  6  1=1.12  MAINS1 

A?4( 1 ,21 ) =DIFF  (A2A, 24.25, I .6.0.1)  MA1N52 

A 24 (  I , 22 ) =D I FF  ( A2A  ,24 ,25 . I , 7 .0 . 1 )  MAIN53 

DO  7  1=1,120  MAIN54 

A2A0I I .7) =DIFF  (A 240, 240,9, I ,3,0.01  )  MAIN55 

A2A0( I ,8) =DIFF  (A? A 0,2 A 0,9, I ,4,0.01  )  MAIN56 

A240( 1,9) =DIFF  ( A2A0, 240, 9,1 ,5,0.01 )  MAIN57 

IF  ( RFCORD.OT . 2 )  GO  TO  48  MAINSR 

A74( 1 ,20) =A740< 1 ,2 )  MAIN59 

A2A1  1  ,73) =0.0  MAIN60 

A2A  (  1 ,?A) =A240(  1 , 1 )  MAIN61 

IN TE OR ATF  ROLL  =  A2A (  I  ,  20  )  .  YAW=A24( 1,73) ,PlTCH  =  A7A(  1,24) 

8  DO  8  1=7,18  MAIN67 

A,  '  l  ,70) =A?A(  1-1 ,201+0.05*1 A24( I  ,7)+A7A(  1-1,7)!  MAIN63 

A  241  ’ ,23>=A24( I -1, 23 1+0. 05* ( A2A ( I , 8 ) +A 24 ( I - 1 , 8 ) )  MAIN64 

A2A  (  I ,24) =A2A(  I - 1 , 24 ) *0 . 95* ( A 24 (  1,17)  +  A 74 (1-1,17))  MAIN65 

C  ON  T I NM  F  MA1N66 

WHFN  1  APF.NF.O  WRITE  OUT  CALIBRATED  DATA  ON  UNIT  l^  (J151S=15)  OR  ON 
UNIT  If  (.114)6=16) 

IF  .APE.FO.O)  GO  TO  10  MAIN67 

WRITF  (J1416)  (  ( A740( I ,J) ,1=1 .120)  , J=1 ,9)  M  A I N  6  8 

WRITF  (J15141  (  ( A74( 1 ,J)  , 1  =  1 ,17) ,J=1  ,74)  MAIN69 

0  CALL  SFLFCT  (iP.lPD)  MAIN70 

SUBROUTINE  SELFCT  SETS  N=2  WHEN  AN  END  OF  F ILF  IS  FNCOuNTFRED 

GO  TO  (21,27) , N  MAIN71 

shift  the  current  cycle  of  calibrated  data  to  the  previous  cycle 


MAIN67 
M  A I N  6  8 
MAIN69 
M  A  I N  70 

MAI N  71 


STORAGE  AREA  SO  AS  TO  ALLOW  THE  DIFFERENT  ION  AND  INTEGRATION 
TO  RF  CONTINUOUS 

DO  15  1=13,74  M  A  I N 7? 
DO  15  J  = 1  , 7 5  MAIN78 
A?4( 1-1 7, J)=A?4( I , J)  MA1N74 
DO  16  1  =  171,740  M  A  I N 7 5 
no  16  J  =  1  , 9  MA1N76 
A740C 1-170, J)  =  A?40(  I ,J)  M  A I N  77 
IF  (RECORO-1701 )  9,11,12  MAIN78 
J 1 516= 1 6  MAIN79 
PRINT  13.J1516  MAIN80 
GO  TO  9  MAIN81 
IF  (RECORD-3401)  9,22,72  MAIN82 
CALL  PRINT  MAIN83 
STOP  MAIN84 
FND  MAIN85 
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ilpnr  <"Yrirx  mpa,xR7,dfck 

Si  (PROMT  I  Nr  CYCLES  I  A  , I*, WORD 

C  SUBPOUT l NF  CYOLFS  EXTRAC TS.CAL I  RA  T !  1  AND  STORES  FOR 
C  OF  100  WORDS 

DIMENSION  A (  A  1 0 ) iMI  100 ) .WORDS! 300) 

COMMON  /Al/  N1 ? ,N1?0, RECORD. 1  UN  I T .N,  ^E.INP'IOO', 
1 X  ARRAY (  S]  ,  1  R )  ,  YARRA  Y  ( *>  ’  .  ]  8 )  , JC  AL (  10  ,I?A,I,*. 
COMMON  /A?/  J1  ,A?4(?A,7M  ,A?A()(7A0,  •  F  Y<  L  F  »  T 

INTFGFR  RFCORD.SFT 
RECORn=RFCORO+l 

r  CALt  RF  AD  ( I  UN  I T . A.IC.N )  THIS  SUBROUTINE  PFRMJTS  r,3' 

C  FORTRAN  IV  TO  IOCS  AND  ALl  OWS  THF  CALL  INS  PRDC,R  M 

C  CONTROL  IF  AN  END  Or  FILF  OR  PEPWANCNT  RE"  '  |Mn '  'ICY  I r 

CALL  READ  (lUNIT.A.K.N) 

C  WRITE  OUT  THF  MPS1  FOUR  RAW  DATA  BJNARv  RECORDS. 

IF  ( RFCORD.LT .6 1  WRITT  (6.10)  (All). 1  =  1,410) 
m  FORMAT  ( 9H 1 A  MATRIX /lX/(  1  X  »  8  0 1  6 ! ) 

N  =  N+1 

C  K  =  NO.  WORDS  IN  RFCORD  A.  GOOD  READ  C N  =  1  >  .  FND  C. 

C  PERMANENT  REDUNDANCY  <N=3> 


A  JuR 


Al  L c  PROM 

:  r 

Jf  O'  l  ,  i  ■  3  1 


FILF  { N  =  2 )  , 


.1 


GO  TO  ( 1  .7.7)  ,N 
1  IF  (F.F0.A10)  GO  TO  = 

WRITr  (6. A)  K  . RECORD, TAPr  ,f! 

A  FORMAT  I1PH0THFRF  ARF  » ? 6 » 3X , 1 7HV0RDS  IN  RECORD  . IS.lX.S-K  TAPP 
1  »  A  6 , 3  X  »  ?HM =  ,  I  S  ) 

CALL  FXFM 

7  WRITF  (6,r>)  TAPF, RFCORD, N 

6  FORMAT  ( 33HOEND  OF  FIl.F  FNCOUNTERFD  ON  TAPF  .A6.11H  IN  RFCORD, 16. 


1  3X ,  ?HN  = .IS) 

DO  17  1=13,24 
DO  ] 7  J=1 ,?S 
17  a?A( ! ,J)=O.D 

DO  )R  1=171,7 AO 


no  1R  J«1 ,R 
in  A  ?A0 ( I , J ) =0. D 


RFTuRN 

3  WRITF  (6,6)  TAPF, RFCORD, N 

o  FORMAT  ( A7H0PFRMANFNT  RFDUNDANC Y  FNCOUNTFRFD  ON  TAPF  ,A6, 

113H  IN  RFCORn  ,  I  6  ,  OX  ,  ?HN=  ,  I  S  ) 

CALL  PRINT 
CALL  FXFM 
7  I ?A=N 1 7 

I 2A0=N 1 70 

C  DO  1?  MAJOR  CYCLES  WITHIN  ONI.  '*10  (06  BIT)  WORD  RECORD. FACH  CYCLE  HAS 
C  100  (12  PIT)  DATA  WORDS 
Of  Q  1=7,076,0/. 

CYCl E  =  CYCLF+1  .0 
I  7  A  =  I  7  A  + 1 


8  M ( J ) =0 

C  CALL  A  MAP  CODED  SUBROUTINE  TO  EXTRACT  THE  NECESSARY  12  BIT  DATA 
C  WORDS  AND  CONVERT  THF  TIME  WORDS  TO  SFCONDS 

CALL  XTRACT  <A(I).M(2)) 

C  CONVERT  THE  1?  BIT  INTEGER  WORDS  (STORED  ONE  PER  36  BIT  WORD)  TO  REAL 
C  FLOATING  POINT  WORDS  AND  PERFORM  THE  NECESSARY  CALIBRATION 
CALL  CALRRT  (M, WORDS) 

CALL  STORF  (WORDS) 

R  CONTINUE 

RFTURN 
PND 
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$[pFTC  STORE c  M94.XR7.DECK 

SUBROUTINE  STORE  (WORDS) 

COMMON  /AT/  N12. N12C, RECORD.  UjNIT.N, TAPE, INP( 100) .JCOL( TOO) . 
IX ARRAY! SI  ,18)  , YARRAY! SI .  1 8 ) , JCAL (1  DO ) , I  24 , I ? AD 
COMMON  /A2  /  J 1  ,  '24  (  24  » 2S  )  » A240  (  240  « 9 )  . CYCLE  »  S*7 T 
INTEGER  set 
DIMENSION  WOPDS(IOO) 

DO  1  L  =  1  .  1 00 
J  =  JC  Al„  (  L  1 

IF  (J.FQ.O)  GO  TO  1 
IF  (J.GT.6)  S'1  TO  2 
IF  (J.FO.l)  1240=1240+1 
A240 ( I  240  » J) =WORDS ( L ) 

GO  TO  1 

2  A24  (  124,  J -6)  =  WORDS  ( t. ) 

1  CONTINUE 

A 24 (  I2a,25)-CVCLE/10.0 

RETURN 

END 
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$In,TC  SFLFCX  DFCK  ,M94»XR7 

SIJBROIIT  INF  SFLECT  «  1.10) 

C  FROM  THF  CALIBRATED  DATA  STORFD  IN  A24  AND  A240  SELECT  THE  SERIES  IP* 

C  IP+IPD.IP+2IPD+...T0  BE  PRINTED 

COMMON  /Al/  N12. N120, RECORD,  IuNlT  ,N. TAPE, INP(  100)  .JCOI-I  100)  » 

IX ARRAY! 51,18) , YARRAY ( 51 , 18 ) , JCAL ( 1 00 ) ,124,1240 
COMMON  / A2 /  J1,A24C24,25)  ,A240(240,9),CYCLF,SFT 
COMMON  / A3 /  PAGE  1(50, 12) »PAGF2 ( 50,13) .PAGE 3(80, 12) 

INTFGFR  RECORD, SET 

1  IF  (  I.LT.IR)  GO  TO  2 
1=1-12 

RFTURN 

2  J= 1 0* I -9 
J1=J1+1 

P  AGE  1 ( J 1 ,  1)=A24(I,19) 

PAGEKJl,  2 )  =  A240  (  J  ,6  ) 

PAGFKJ1,  3 )  =  A24 (1,6) 

PAGEKJl,  4)  =  A24(  T  ,21  ) 

PAGEKJl.  5  )  =  A240  (  J  .  1  ) 

PAGE  1 ( Jl,  6 ) = A 24 (  I ,24) 

PAGE 1( Jl ,  7 ) = A 24 ( I ,17) 

PAGEKJl,  8  )  =  A240  (  J  ,  3  ) 

PAGEKJl.  9  )  =  A240  (  J  ,  7  ) 

PAGFK  J1,10)  =  A?4(  1,4) 

PAGF1IJ1 . 1 1 ) *A24  (  1  ,5) 

PAGElt  J1.12)=A24(  I  ,9) 

° AGF2 ( J 1 ,  1 ) = A24 ( I ,19) 

PA6F2U1,  2)  =  A24(  1,7) 

PAGE2I Jl,  3 ) = A24 ( I ,22) 

PAGE 2 ( J 1 ,  4 )  =  A240 ( J  ,2 ) 

PAGE2IJ1.  5 ) =A24( 1,20) 

PAGE  2  (  Jl  ,  M=A24(t,2) 

PAGF2U1,  7 )  =  A 240 (  J , 4 ) 

PAGE 2 ( Jl ,  8 )  =  A240 ( J  ,8 ) 

PAGF2( Jl,  9 ) = A  24 (  1,3) 

PAGE2<  Jl .10) =A24(  1,73) 

PAGE2( J1.11)=A24(  1.8) 

PAGE  7 ( Jl . 1 2 )  =  A740  (  J,S) 

P  AGE 2  (  J 1  ,  1  3  )  =  A  2 40  (  J  ,  9  ) 

PAGE 31 Jl ,  1 )  = A24 (  1,19) 

PAGE3IJ1.  2 ) = A24 ( I ,13) 

P AGF3 ( Jl ,  3 ) = A24 ( 1,15) 

PAGE3( Jl,  4  )  - A24 (  1,14) 

PAGF3I Jl,  5  )  =  A74 (  I ,16) 

PAGE3I Jl,  6)*A?4( 1,11) 

P AGE3( Jl ,  7) =A24 ( I , 10 ) 

PAGF3I Jl .  8 ) = A  74 (  I ,17) 

PAGF3I Jl  .  9 ) =A  74 (  1,1) 

P  AGE  3(J1*10)=A74(  1,18) 

PAGE 3 ( J1,11)=A74(  1,25) 


PAGE 3 ( J1,12)=REC0RD~1 
IE  (J1.LT.50)  GO  TO  35 
CALL  PRINT 
38  I = I + ID 

GO  TO  1 
END 
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SI^FTC  PRINTS  0FrK.M94.XR7 
SUBROUTINE  PRINT 

COMMON  / A2 /  J1 . A24 ( 24, 25  I  ,A240( 240.9) .CYCLE. SFT 
COMMl J  / A3/  PAGE 1<  SO, 12) , PAGF2(50»13) .PAGE 3(60.1? ) 

INTEGER  SFT 
IF  (Jl.FQ.O)  RETURN 
SET  =  SET  +1 

14  WRITE  (6,311  SFT 

31  FORMAT  (13H1PAGF  1  SFT,  IV 

C  SX.4HTIMF.10H  AIRsPFFO.llH  AL T I TUDF , 10H  VFRT 

1 ICAL,Sx,5HP1tCH,7X,SHPItCH,4X.SHPItCH,12H  STICK  P0S..13H  STlFK 
PRATE, 11H  FLFvATOR.UH  ELFvATOR,flX.6HNORMAL/3?X,BHvELOClTY,10H 
•j  (  ACTUAL  1  ,  1  PH  (  COMPuTrr'  1  .Sx.4HRATF.Sx  ,7H{  LONG.  )  ,6X  ,  7H  (  LONG.  )  ,  SX  ,6 
4HTAR  IJP.HH  TAB  OOWN.UH  ACC ELFRA T I  ON/ 1 X > 

WRITE  (6,41)  ( (PAGE1 ( !R. 1 C )  , FL  AG1 ( IR.1C) » I C  =  1 , 12 )  , IR=1 »J1 I 
41  FORMAT  ( lx,F7.?,Al,F9,?,Al»Fl0.2,Al,F9.?tAl ,f9.2,A1,F11.2,A1 .PR.?, 
1A1,F11.2,A1,F12.2,A1  ,F10 . 0 ,  A1  .FlO.O ,  A 1  .FH.2.A1  1 
WRITE  (6,32)  SFT 

3?  FORMAT  (13H1PAGF  2  SFT.  IS/ 

C  4X.4HTIMF.9H  HFADING.4X  »4HTURN,6X .4HR0LL  »  PX ,4 HR 

10LL.Sx.4HR0LL.12H  STICK  F0S..12H  STICK  R A TF . 7X , 7HL ATFRA L .°X , 3HYA 
?W,6X,7HYAW,8H  RljOOFR  ,9H  RllDOFR/ ?  1  X  ,  4HRATF  ,  1  OH  (ACTUAL), 1PH  (C 
30MPUTFOI.SX.4HRATF.12H  ( LAT FRAL ) » 1  PH  ( LATERAL ), 14H  ACCFLFPATl 
40N.12H  ( COMPuTFO ) , SX .4HRATE . 13X .4HRAT F/ 1  X ) 

WRITE  (6,42)  MPAGF2I  IR.  IC)  .FLAG2I  IR.  IC)  ,  I  C=  1 .13)  ,  I  R=  1  ,J1  ) 

4  p  FORMAT  ( 1X.F7.2.A1 ,F7«?,Al»F7.2»Al ,F9,2»A1.F11.?»A1 »F8.2,A1,F11.2, 

1A1,F11.2,A1»F13.2,A1»F11.2,A1»F8.?,A1»F7.?,a1.F8.?»A1) 

WRITE  (6,33)  SFT 

33  FORMAT  (13H1PAGF  3  SFT.I5/ 

C  SX.4HTIME.11H  THR0TTLF.7X.3HRPM.11H  THROTTLE 

1 .7X.3HRPM.8H  SPEED , SX . SHFL APS . 10H  LANDING, 7X.6HTHRUST , QX » 

2SHFVFNT  »9X ,4HT I ME  »  7X .6HREC0R0/ 14X  »6H( LFFT ) »4X  »6H ( l.FF  T 1 »4X , 7H( R I GHT 
31.10H  (RIGHT), 8H  PRAKE.16X.4HGFAR.13H  ATTENUATOR . RX ,6HN||MRFR 
4.8X.5HCYCLF/1X) 

WRITE' (6,43)  ( (PAGF3I I R, I C ) , FL AG3 ( IR , IC ) , I C = 1 , 1 2 ) , I R= 1 , J1 ) 

43  FORMAT  ( lX»F7.2,Al,F10.2,Al»F9.2»Al,‘r10.?,Al .F9.P.A1 , F7.0 , A1 »F9, ? , 
1  A] .F9.0.A1 .F1P.0.A1 .F13.0.A1 .F12.1 .Al.FIP.D.M ) 

J1=0 

RETURN 

END 


/ 
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$1 PMAP 

XTRATC 

DFCK 

XTRACT 

SAVF 

< 1,2,4  ) 

CLA 

3,4 

ST  A 

N  1 

STA 

N3 

ST  A 

N(S 

STA 

NIP 

CL  A 

4*4 

STA 

N? 

STA 

N4 

STA 

N  1 

STA 

N8 

STA 

N12 

N 1 

LDO 

t< 

ROL 

2S 

PXA 

,0 

LLS 

CHS 

10 

N? 

STO 

** 

AX  T 

-1.2 

AXT 

-1.1 

N3 

LDQ 

**.  1 

AXT 

3.4 

NS 

ROL 

1 

PXA 

.0 

LLS 

10 

CHS 

/ 

N4 

STO 

**,2 

ROL 

1 

TX! 

*+l .2.-1 

TIX 

NS, 4,1 

tx  r 

*+1,1 ,-l 

TXH' 

N3,l ,-32 

Nf> 

LOQ 

**.l 

ROL 

1 

PXA 

,0 

LLS 

CHS 

10 

M7 

STO 

**.2 

ROL 

1 

TX  i 

*+l ,?,-l 

ROL 

1 

PXA 

,0 

LLS 

CHS 

10 

NS 

STO 

**,2 

PXA 

,0 

AXT 

0,4 
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RQL 

1 

N9 

RQL 

1 

TOP 

*  +  2 

Ann 

SFC1 ,4 

TXI 

*  +  l .4,-1 

TXH 

N9.4.-1  1 

TXI 

*+1.1 .-1 

N10 

LDQ 

**.l 

AXT 

0.4 

ROl 

1 

Nil 

ROL 

1 

TOP 

+  +  2 

Ann 

SFC2.4 

TX  I 

*+l .4.-1 

TXH 

Nil .4,-10 

TXT 

*+l ,7,-1 

N1  ? 

ETC 

** ,  2 

RFTURN 

XTRAFT 

5FC1 

DFC 

240 

DFC 

72000 

DFC 

36000 

dfc 

28800 

DEC 

14400 

DEC 

7200 

DEC 

3600 

DEC 

2400 

DFC 

1700 

DFC 

600 

DF1" 

480 

SFC2 

DEC 

120 

DFC 

60 

DFC 

*0 

DFC 

70 

DEC 

10 

DEC 

8 

DEC 

4 

DFC 

7 

DFC 

FND 

1 
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t 1 RM AP  SIO.  DECK  SEPT  DOWDFLL 

ttl  simpliftfd  :ors  subroutine 

*  SIMPLIFIED  t NPl)T  -OUTPUT  OONTROL  SYSTEM  -  21  SFPTFMRFR 
»■  THIS  SUBROUTINE  PFRMITS  direct  call  from 
»  FORTRAN  IV  TO  IOCS  ROUT  I NES (  OPEN . READ ,WR I TF .CLOSF ) 


THE  VARIOUS  CALLING  SEQUENCES  ARF- 
CaLL  CLOSE(N.M) 

N=LOG I  CAL  TAPE 

M=(0=NO  REWIND*  NO  EOF  ON  OUTPUT) 

=  (  1  =  RFW IND,  WRITE  FOF  ON  OuTP(lT) 

= ( ?=NG  RFWIND.  WR I TF  FOF  ON  OUTPUT) 

=(3=RFwIND,  UNLOAD,  wRITF  FOF  ON  OUTPUT) 

MODIFIED  SIO.  TO  RETURN  THE  WORD  COUNT  IN  K 
(ALL  READ! N.A-K, J) 

N=LOGICAt.  TAPE 

ALLOCATION  OF  DATA  AREA  FOR  READ 
K=NUMRFR  OF  WORDS  TO  BE  READ 

J  =  STATUS  SWITCH(0  =  GOOD  READ).(1=END  OF  FILE)  ,(2  =  PERM  REDUN) 
CALL  WRITEIN.A.K) 

N=LOGI CAL  TAPE 

ALLOCATION  OF  AREA  FOR  WRITF 
K=NUMRFR  OF  WORDS  TO  RF  WRITTEN 
CALL  RKSFILIN.M) 

N=LOGI CAL  TAPE 
MlNO.  of  FILFS 
2 

READX, READY 
WRITX.WRITY 
CLOSX.CLOSY 
BKSFX.BKSFY 
2 

SAVE  AND  EXIT  FOR  ALL  ROUTINES 
( 2. A)  ,  I 


READ 

WRITF 

CLOSE 

BKSEIL 


SAVF 


EXIT 


CLOSX 


SPACE 

CONTRL 

CONTRL 

CONTRL 

CONTRL 

SPACE 

REM 

S„VFN 

SX  A 

TRA 

AX  T 

RETURN 

SPACF 

RFM 

SX  A 

TSX 

CLA* 

PAC 

LDQ 

RQL 

SLQ 

TSX 


LK.DR.4 
1  .1 
**.l 

SAVE 

2 

CLOSF  SUBROUTINE 
EX  I T  ,  1 
SAVE  *  1 
4*4 
0,1 

PREFIX 

0,1 

CL0SF1+1 
FVIO, 1 


EXIT  ROUTINE 


SAVE  ROUT  INF 
SET  RFWIND  OPTION 

ROTATE  PREFIX  CONSTANT 
TO  FORM  DFS I  RED  PRFFIX 
PZF,MZF  PTW.MON 
FIND  LOO ( FOR ) 
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SIO.  000 
SI0CS002 

SI0CS005 

SI0CS006 

SIOCS007 

SIOCS008 

SI0CS009 

SI0CS010 

SI0CS011 

SIOCS012 

SI00S013 

SIOOS014 

SI0CS01S 
SIOCS016 
SI0CS017 
SIOCS018 
SI0CS019 
S  IOCS020 
SI0CS021 

SI  or SO 2 2 

SI0CS02? 
SIOCS024 
SI0CS02S 
S I0CS026 
S I0CS027 


SI0CS032 

SIOCS03S4 

SI0CS035 

SI0CS036 

SI0CS037 

SI0CS038 

SI0CS039 

SI0CS040 

S I0CS042 
SI0CS043 
S  IOCS044 
S  IOCS045 
S  I0CS046 
SI0CS047 
S I 00 SO 4 8 
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CLA 

F. 

STORE  lOC(FCB) 

ST  A 

CLOSFl+1 

CLOSE!  TSX 

.CLOSF.A 

CALL  TO  IOCS 

PZF 

#* 

tra. 

EXIT 

RETURN 

CLOSY  BSS 

0 

SPACE 

2 

REM 

READ  SUBROUTINE 

ReADX  SXA 

FXIT.l 

TSX 

SAVE  *  1 

SAVE  ROUTINE 

SXA 

RFAD2.4 

CLA 

4*4 

FIND  RF AD  ADDRESS 

ST  A 

READ1+3 

CLA 

S,4 

STA 

00 

STZ* 

6*4 

ZERO  ERROR  SWITCH 

TSX 

FVI0.1 

FIND  LOC(FCB) 

CLA 

E. 

STA 

REA01+1 

ST  A 

OPN+1 

STA 

CLS+ 1 

PAC 

0,1 

LOI 

1*1 

FCR  WORD  2 

LPT 

oosooo 

WAS  PREVIOUS  MSF  INPUT 

TRA 

*+2 

NO*  MUST  RFSET 

TRA 

READS 

YES.  C,0  CHECK  OPFN 

LFT 

040000 

IS  FILE  CLOSED 

TSX 

CLS.2 

NO,  CLOSE  IT 

LDI 

1*1 

RIL 

003000 

SET  TO  INPUT  100! 

ST  I 

1.1 

TRA 

*  +  2 

READS  LNT 

040000 

IS  FILE  OPFN 

TSX 

0PN.2 

READ1  TSX 

.RFAD.4 

CALL  TO  IOCS 

PZF 

»# 

PZF 

READ2  * ,READ3 

POF,  ,REDt!N 

I ORT 

**..** 

LXD 

*-1.1 

QQ  SXA 

**,1 

TRA 

EXIT 

READ2  AXT 

**  ,4 

RESTORE  IR4 

CLA 

=  1 

SET  EOF  SWITCH 

STO* 

6*4 

TRA 

EXIT 

RETURN 

REAJ3  xec 

READ2 

RESTORE  IR4 

CLA 

*2 

SFT  PERM  RFDUN 

STO* 

6*4 

SWITCH 

tra 

FXIT 

RETURN 

Rr*nv 

0 

SI0CS049 

siocsoso 
S IOC SO 51 
SIOCS05? 
SIOCS05S 

S10CS054 

SIOCS05S 

SI0CS057 

SI0CS058 

SIOCS059 

S10CS060 


SIOCS064 

SIOCS065 

SIOCS066 

SIOCS067 

SIOCS068 

SI0CS069 

SI0CS070 

S I0CS071 

SIOCS07? 

SI0CS07S 

SIOCS074 

S I0CS075 

SIOCS076 

SI0CS077 

SIOCS078 

SIOCS079 

SIOCS080 

SIOCS081 

S10CS08? 

SIOCS08S 

S10CS084 

SI0CS085 


SI0CS087 
SIOCS088 
SIOCS089 
SIOCS090 
b  IOC  SO  91 
SI0CS092 
SI0CS09S 
SI0CS094 
SI0CS095 
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fPAcr 

? 

5  IOC SO 96 

RFM 

WRITF  SUBROUTINE 

SI0CS097 

WRITX  SXA 

FX IT  *  1 

TSX 

SAVF  •  1 

SAVE  ROUTINE 

S IOCS099 

CIA 

4  •  A 

FIND  WRITF  AOORFSS 

SIOCSIOO 

STA 

WRITFU? 

SI0CS101 

CL  A  * 

S.4 

FIND  NO  WORnS 

stocsio? 

p  a  y 

o.i 

SIOCSIOA 

sxd 

WR1TF1*?,! 

SIOCSlOA 

isy. 

FVlO* 1 

FIND  lOf(FCR) 

S10CS10S 

CLA 

Ft 

S IOCS  106 

STA 

WRITF1+1 

SIOCS107 

ST  A 

OPNM 

SI0CS106 

STA 

CLS+1 

S  IOCS  109 

PAC 

u*l 

siocsno 

ldi 

1  *1 

FCR  WORO  2  TO  1  NO | CAT QRS 

siocsm 

LFT 

ooiooo 

FX  AM  I NF  FOR  PRFVIOIJS  ACTIVITY 

SI0CS112 

TRA 

WRITF5 

PRFVIOUS  NOT  INPUT 

siocsm 

LF  f 

040000 

INPUT.  IS  FIlF  CLOSED 

SIOCSllA 

TSX 

CLS.7 

NO.CLOSF  IT 

SIOCSUS 

LDI 

1  <1 

SI0CS1 16 

R I  L 

oosoon 

SFT  PITS  FOR  OUTPUT  (01) 

siocsm 

I  1  L 

ooiooo 

SIOCSllB 

ST  1 

1*1 

SI0CS119 

TRA 

•  •f? 

S  IOCS  120 

WRfTFS  LNT 

040000 

IS  FILF  OPFN 

SICCS121 

TSX 

OPN  *  ? 

NO.OPFN  FIlF. 

ST0CS1 22 

WRITEI  TSX 

•WRITF.4 

CALL  TO  IOCr 

siocsm 

P7T 

«« 

SIOCS 12A 

I  ORT 

TRA 

F  X  1  T 

RFTIIRN 

SI0CS1 26 

WRITV  RS.S 

0 

SPACF 

2 

SIOCS127 

RFM 

RACKSPACF  FfLF 

ROUT  INF 

S IOC  S 1 28 

Bfxc>FX  SX  A 

rX  1  T  •  1 

TSX 

SAvFtl 

SAVF  ROUT  INF 

siocsno 

TSX 

FV  1 0  *  1 

FIND  LOCIFCRI 

siocsm 

CLA 

F. 

SIOCS132 

STA 

C  L  S-*  1 

SI0CS1 33 

STA 

PSXFL1+1 

storm* 

LX  A 

LK.DR.4 

SI0CS13S 

CLA* 

4*4 

FIND  NO.  OF  FILFS 

SI0CS136 

PAX 

0*1 

SI0CS1 37 

TXL 

FX!T*1*0 

FX I T  IF  0 

SI0CS13B 

TSX 

CL  S  ,  ? 

CLOSF  F  I  LT 

S IOCS  1 39 

BSXFL1  TSX 

.NOSFL  *4 

siorst/iO 

P7F 

**t»6 

BACKSPACF  1  F  I  Lr 

S IOCS  1 A I 

T  IX 

RSKFL 1.1.1 

i'ONTIN'IF  FOR  M  FTLFS 

MOCSl-  2 

TRA 

FX  1  T  COMPLFTF  CO  HOMF 

SI0CS1A3 

R<  SFY 

PSS 

0 

SI0CS1AA 

sPAcr 

7 

RFM 

OPEN  ANO  CLOSF  ROUT  T  NF 

SI0CS1A6 

OPN 

TSX 

•  OPFN  *4 

SI0CS1A6 

M7F 

## 

SI0CS1AT 

TRA 

1  9  7 

S10CS1AB 

cls 

TSX 

•  c  loef  .4 

SI0CS1A9 

MOM 

## 

siocsno 

TRA 

1  •? 

siocsm 

sPAcr 

7 

siocsn? 

RFM 

ROUT  INF  TO  LOCAtF  FILF  CONTROL  BLOCK 

SI0CS1S3 

fvio 

CLA 

3,4  FIND  LOGICAL  NljMPFR 

SI0CS15* 

STA 

#44 

SIOCS155 

CALL 

.FvIO*<»*.F.) 

SI0CS1S6 

T-A 

1.1  FTU-N 

s iocs  n  7 

SPACF 

7 

SI0CS15B 

REV 

CONSTANTS  ANn  VARIABLES 

s iocs n 9 

EPACE 

1 

SI0CS160 

REM 

THF  FOLLOWING  CONSTANT  ll«-Fn  TO  ESTABLISH 

siocs  m 

RFM 

OPFN  ANO  CLOSF  PREFlX.BY  SHIFTING 

SI0CC16? 

REM 

WITH  THF  DFS1RFD  OPTION  CODE.  THF  NORMAL  PRFFIXFs 

siocsm 

RFM 

OE  -1  ,  +2.-0  ,  AND  -*0  CAN  PE  OPT  A  INTO 

S IOCS  1 6A 

Pt<  c  F  I  X 

MON 

S10CS16S 

F  • 

P2F 

0 

SI0CS166 

LX. OR 

LDIP 

F  NO 

A  IOC S 1 67 
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JIPMAP  UNITS  17,MP4.r)FrK 

FNTPY  .IINIA. 

.UN14.  PZF  UN  I T 14 

UNITlA  FILF  ♦A(l) .INPUT. BIN. BLK=410 

FNTRY  .HN1F. 

.UN15.  PZF  UN  I T 1 5 

UN  t  T 15  FILF  ,A(2) , I NOUT . AIN .BLK« 1080 
FNTRY  .UN16. 

•  U M i 6 •  PZF  UN  I T 16 

UN  1 T 16  FILF  * A( 3 ) « I NOUT  »BIN»8LK=1080 
FNTRY  .UN  17. 

.UN  17.  PZF  UN  I T  1  7 

UNIT17  FILF  .ACM .OUTPUT. RIN.BLK“108P 
FNTRY  .UNlfl. 

.UNlB.  PZF  UNIT18 

UN  IT  18  FILF  * AC  8 ) .OUTPUT .PIN  *RLK= 1080 

FNO 
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'  f NO  OF  FtLf  FARO 

X1896  92  RFCORDS  RY  COUNT 

IMAM!  ITAPF=1 . IP* 1  ,  IP0=10$ 


0  1 

2  3 

4  5 

6  0 

0 

0 

0 

1 

•S 

a 

6  5 

6  7 

0  0 

0  1 

2  3 

4  5 

6  8 

i.i 

0 

0 

1 

t 

4  5 

f  9 

10  1  1 

12  1 

2  3 

4  5 

6  13 

0 

0 

14 

1 

? 

3 

4  5 

•5  1  0 

16  17 

1  8  1 

2  3 

4  5 

6  0 

0 

0 

0 

1 

*3 

C 

•3 

4  9 

6  P 

0  0 

0  1 

2  3 

4  5 

6  0 

0 

0 

0 

1 

2 

a 

4  9 

6  0 

0  0 

0  11 

27  19 

17  19 

16  -1 

0 

0 

0 

lc 

2 

7  1  O 

W  1 

16  l  o 

0  0 

0  11 

27  19 

17  19 

16  13 

-1 

-1 

0 

1  5 

? 

7  19 

17  1 9 

1  6  1  3 

39  1  9 

2  11 

27  19 

17  19 

16  6 

-1 

-1 

5 

11 

7  7  19 

11  19 

If.  5 

7  7 

19  1 9 

27  19 

17  19 

16  -3 

0 

o 

<i 

1  5 

'  9 

If  19 

1  6  0 

0  0 

0  1  9 

27  19 

17  19 

16  0 

0 

0 

0 

1  5 

2  7  19 

17  19 

16 

0  0 

0  1 

2  3 

4  5 

6  7 

0 

0 

0 

1 

1 

4  5 

6  6 

0  0 

0  1 

2  3 

4  5 

6  9 

10 

1 1 

0 

1 

? 

3 

4  5 

6  1? 

13  14 

19  1 

2  3 

4  5 

6  16 

17 

16 

19 

1 

3 

4  5 

6  20 

21  22 

23  1 

2  3 

4  5 

6  24 

0 

0 

0 

1 

3» 

4  1 

6  0 

0  0 

0  1 

2  3 

4  5 

6  0 

0 

0 

0 

? 

3 

4  9 

2  b 

0  0 

WOPDO  2 

PITCH 

15 

• 

■>.90 

3.36 

3.22 

3,08 

2. 

96 

2 » 

79 

2  „  5  A 

?  „  3  6 

2.31 

:.n7 

1.93 

1.77 

1  .63 

1. 

49 

70. 

60. 

50. 

40. 

30 

• 

?( 

• 

1' 

0. 

i  o. 

-  70. 

-30. 

-40. 

-50. 

-60. 

-70. 

wop  r>o? 

ROLL 

27 

5.00 

4.27 

4.12 

3.98 

3. 

83 

3. 

1  H 

> 

•  *7  ; 

7 ,  7') 

yi 

3.10 

2.95 

2.79 

2.65 

2,50 

2. 

36 

2. 

21 

3 

#  *>  7 

1  .  *9 

'  .  77 

1.97 

1 .48 

1 .34 

1  «  1  o 

1  .05 

0. 

91 

0  • 

86 

»  *  '^! 

180. 

120. 

no. 

100. 

90 

• 

80 

• 

ft 

<  6  . 

10. 

40. 

30. 

20. 

10. 

0. 

-10. 

-20. 

3  >. 

'  V 

-  50  . 

-60. 

-70. 

-80. 

-90. 

-100. 

-110. 

-120. 

JS  1 , 

W OR 00 4 

ST ICKO 

19 

.18 

.60 

.78 

1  .00 

1. 

24 

1  . 

4b 

) 

.  66 

1 . 0  9 

:■ .  1 4 

2.  76 

;  .  59 

2.84 

3.09 

3.32 

3. 

57 

3. 

*3 

fv, 

..  10 

.  3 

'1  .  7-, 

-14.9 

-10. 

-8. 

-6. 

-A 

• 

-  2 

« 

r> 

. 

'  1 

4  , 

6  . 

8. 

10. 

12. 

14. 

1  6 

• 

l  p 

4 

ft 

"l 

WORDOI 

ST  ILKA 

17 

.  27 

.45 

.81 

1.11 

1. 

4  3 

i 

-  ft 

i 

.96 

'>  "7 

ft  ft  •' 

’  r  '9 

2.79 

3.0 

3.28 

3.61 

3.89 

4  • 

23 

4  ft 

59 

£, 

.•70 

12. 

14. 

12. 

10. 

8. 

6. 

• 

7 

* 

-2. 

-4. 

-6. 

-8. 

-10. 

-12. 

-  14  , 

- 

1  6. 

WORD 06 

RUODfc'R 

19 

.07 

.4 

.8 

1.18 

1  . 

57 

1. 

78 

.0., 

2. 1  1 

2.4  0 

2.54 

2.80 

3.00 

3.20 

3.40 

3. 

60 

4. 

00 

«♦ 

.  AO 

4 . 8  j 

9.00 

24. 

22. 

18. 

14. 

10 

1  ft 

8. 

A 

. 

4  « 

2. 

0. 

-2. 

-4  . 

-6. 

-8. 

-10. 

-  1 

4. 

- 

19. 

-?*>* 

-2  4  . 

1-109007 

AIR1P0 

16 

.  491 

.  7836 

.9065 

1.019 

1. 

11? 

i  . 

3)0 

1 

,191 

7.165 

2.438 

2.723 

3.006 

3.267 

7.529 

3. 

790 

4. 

025 

0. 

60. 

70. 

80. 

90. 

1  00. 

1 

?n. 

f  <■ 

ICO. 

U.o. 

200. 

220. 

240. 

260. 

280. 

300. 

28. 
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W0RP18  ROLLRT  19 


h  •  66 

4.13 

3.695 

3.0  7 

2.546 

2.03 

1.51 

1.0 

.49 

0. 

-.495 

-1.0 

-1.51 

-2.03 

-2.545 

-3.08 

-3.60 

-4.125 

-4.65 

1  80. 

160. 

140. 

1  20. 

100. 

80. 

60. 

40. 

20. 

0. 

-20. 

-40. 

-60. 

-80. 

-100. 

-120. 

-140. 

-  16". 

-180. 

WORP?R 

LATArr 

13 

2.09 

1.91 

1.74 

1.67 

1.46 

1.30 

1.15 

0.99 

.3 

• 

03 

0.67 

0.4  2 

0.36 

1.20 

2.0 

2.5 

/. 0 

1.5 

1.0 

.5 

0. 

-.5 

-1.0 

-1.6 

-2.0 

-2.6 

-3.0 

WORD38 

ALT  I  TP 

IS 

.103 

.  163 

.226 

.29? 

.379 

.450 

.647 

.896 

1.206 

1.480 

1  .  787 

2.100 

2.397 

2.689 

3.00? 

3.309 

3.596 

3.908 

890- 

1000. 

1 50n  . 

2000. 

250"  • 

300°  • 

400" . 

6000. 

8000. 

10000. 

12000. 

14  000 

•  16000  • 

1 8  OOP • 

20000. 

22000. 

?4"00. 

2600". 

W  OR  P  3  9 

HF APNO 

35 

0. 

.128 

.281 

.4  04 

.563 

.70] 

.  840 

.988 

1.13  7 

1.280 

1.424 

1.567 

1.711 

1.964 

2. "03 

2.151 

2.  305 

2.448 

2.581 

2.730 

2.879 

3.017 

3.166 

3.374 

3.468 

3.616 

3.744 

3.916 

4.001 

4.17n 

4  .  246 

4.282 

4.308 

4.3  34 

4.359 

560  . 

350. 

340, 

330. 

320. 

310. 

300. 

290. 

280. 

270. 

26o. 

250. 

240. 

730. 

220. 

210. 

200. 

190. 

180. 

170. 

160. 

150. 

140. 

130. 

120. 

110. 

1O0. 

90. 

80. 

70. 

60. 

50. 

40. 

30, 

20. 

WORP40 

YAWRTF 

15 

4.75 

4.135 

3.501 

2.84 

2.14 

1.425 

.705 

0. 

-.73 

-1.45 

-2.  165 

-2.87 

-3.54 

-4.17 

-4.78 

70. 

60. 

50. 

40. 

30. 

20. 

10. 

0. 

-10. 

-20. 

-30. 

-40. 

-50. 

-60. 

-70. 

W0RP4 1 

NORAfT 

2 

4.9 

+  4  .9 

-7.0 

+  7.0 

U0RP48 

Ft 

APPO 

6 

4.86 

3.76 

7.86 

1.90 

1.00 

.  1 1 

0. 

70. 

40. 

60. 

80. 

100. 

WORDjl 

THROTL 

5 

.23 

1.72 

2.76 

3.72 

4  •  64 

0. 

16# 

32. 

48. 

64. 

WORC  58 

throtr 

5 

.  36 

1.82 

2.87 

3.85 

4.61 

0  . 

16. 

32. 

48. 

64. 

W ORP  5  6 

rpmlft 

7 

.  7 

1.4 

2.1 1 

2.82 

3.55 

4.28 

5.00 

14.28 

28.57 

42.85 

67.14 

71.4? 

85.71 

1 00.00 

WORP60 

RDVRHT 

7 

.56 

1.17 

1.69 

2.27 

2.88 

’.46 

4. 00 

14.28 

28.67 

42.85 

67.14 

71.4? 

85.71 

100.00 

rfOR061 

°  I  T  C  H  R 

19 

4.98 

4.47 

3.9? 

3.36 

2.79 

2.23 

1 .66 

1.095 

.  545 

0. 

-  .  63 

-1  .08 

-1.635 

-2.21 

-2.77 

-3.34 

-3.90 

-4.45 

-4.99 

90. 

80. 

70. 

60. 

50. 

40. 

30. 

20. 

10. 

0. 

-  1  C  • 

-20. 

-30. 

-40. 

-5o  « 

-60. 

-70. 

-80. 

-90. 

cnp  nr  file  carp 
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GLTHR-~  -7/14/6S 

CALPTP  -  EFN  SOURCE  STATEMENT  -  I PJ  ( S )  - 


SUBROUTINE  CALeRT  (M.WURCS) 

CIRENSICN  M  ICC  ) .WCRCSU'  > 

CORRC'N  /Al/  N12,N12G, RECORD,  IUN IT  ,N  ,  T APE , I NP (  Utl  .JCOLlll’O)  , 
IXARKAY<51 ,18) ,YARRAY(51 ,18)  ,  JCALUOU),  124,  1240 
CO  1  L=1 » ICC 
NP  = I N  P  (  L  ) 

IF  (NP)  ’,7,5 

7  WORDS  (L )=C.O 

GO  TO  1 

2  IGO-NP 

GO  TO  (4,5,6,81 , ICC 

4  VtORLS  (  L  )  =0.0 
WORC=ML) 

VOL TS=0. *051281 *ABS(WORO) -0.1256 
IF  (WCRC.LT.O.C )  VCLTS=-VQLTS 
IF  (VOLTS. CE  .  1.0)  WCRDS(L»=1.G 
GO  TO  1 

5  W 0 R L S ( L ) *M (L  ) 

GO  TC  1 

6  N(L)*-ML) 

C  FVFNT  NUMBER  P  S  ?C0  ICO  8C  40  20  10  8  4  2  1  THAT  IS  BCD  AND  NOT 
C  BINARY  COUNT 

M*(ML)/256)  *100 
M2IMCD (MIL), 256 ) 

M 1  *  M 1  + (M2/16)*1C+MC0(M2, 16) 

WORCS ( L ) =M  1 
GO  TC  1 

8  WORL=M(L> 

VOLTS  =C.0051281*AB S(hORO)-C. 1256 
IF  (NCRC.LT  .')•■;)  VCLTS--VOLTS 
WORCS  ( L ) =VCLTS 
GO  TC  1 

3  WORL  =  W ( L  ) 

VOL TS=C. 005 128 1* AHS (WORD l-C. 1256 
IF  (WCRC.LT.O.C)  VOLT  S  =  -VOL  TS 
J  =  JCC  L ( L 1 

CALL  AITKEN  (XARRAY(1,J),YARRAY(1,J ),  VOL T S , WORD S ( L ),0IF,51,NP,1,K1 
l.JJ) 

1  CONTINUE 

RETURN 
ENC 
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CLTHKE 

AITKN 


EFN  SOURCE  STATEMENT 


I FN  I  S  > 


07/14/69 


SUU  KC  LT I NE  AITKEN  ( X, Y  ,X I , Y l , D t F ,M,  N, I  NT ,K 1 , J » 

CIMcNSlCN  X(»J  ,YCM),XX(ll»,YYan,OIFF(ll) 

C  CK  TC  CROP  THE  FIRST  BAD  POINT  FROM  EITHER  SIDE  AND  CONTINUE 
KsMAXlML*  DIMENSION  OF  X  ANC  Y  VECTORS 
N=NLMPER  of  POINTS  IN  THE  X  AND  Y  VECTORS  THIS  CALL 
LEFT  ANC  CHANGE  <LRS=i!  RIGHT  ANC  CHANGE  ILKS*2) 

LEFT  ALWAYS  <LRS=3I  RIGHT  ALWAYS  (LRS*4» 

X  =  4  5  6  7  8  X I  =  5  •  5  K  WOULD  BE  2 

PARAMETERS 

X-1NCEPENOENT  VARIABLE  Y*DEPENCENT  VARIABLE  N=NUMBER  POINTS 

X I  =G  I V EN  X  YI*REQUREC  Y 

Kl=POSITICN  OF  THE  LEFT  MOST  X  USED  J=THE  NUMBER  OF  POINTS  USED 


INTEGER  l 
J=1 

C I F  =C . G 
CIFF(1I=1.CE37 
Kl  = 

Y  I  ■  C  .  C 

IF  (N.GT.l)  GC  TC  93 
WRITE  (6, A)  N 

A  FORMAT  (3HCN=, 1 1 2 , 3 X , 5CHTHERE  ARE  LESS  THAN  TWO  POINTS  IN  THE  (X, 
1(  TAPLS.) 

CALL  F XE M 

9C  IF  IXlll.GI.X(M)  GO  TC  1903 

if  ixi-xmi  5^,6vv,eto 
500  K=1 

l»S-4 

GO  TC  2  R/Vl 

6C0  K 1  -  1 

y i  *Yin 
Rp  T  LRN 

8C0  IF  IXI-XIMI  1200,900,1100 
900  K1=N 

YI-YIM 
RETLRN 
HOC  K*N 

LR  S  =3 

GO  TC  2 BO.! 

120C  LL  =  1 
LU  =  N 

130C  IF  ( ( LU-LL 1.60.1)  GO  TC  1400 
LI=(LL+LL)/2 

IF  (XI-X(LI))  1800,1700, 1600 
160C  LL  =  L I 

GO  TC  1300 
170C  K 1  =  L I 

Y I  =  Y  (  L  I  I 
RSTLRN 
1P0C  LU  =  LI 

GO  TC  1300 

190C  IF  IXI-X(ll)  2C0C  ,  600 , 500 
2000  IF  (X  I-XIN  H  1100,900,2103 
210C  LL  =  1 


AITKNCC1 
AITKNC .2 
AITKN033 
AITKNCC4 
A 1 TKNGo  5 
AITKNC. 6 
AITKNC. 7 
AITKNCvB 
AITKNCG9 
AlTKNClu 
AITKNOll 
AITKNC12 
AITKNC 13 
AITKNC14 
A ITKNC15 
AITKNG16 
AITKNC17 
A 1TKNC 18 
AITKNC19 
AITKNC20 
AI TKNC21 
AITKNC22 
YAITKNC23 
AITKNC24 
AITKNC25 
AITKNC26 
A1TKNC27 
AITKNC28 
A ITKNC29 
AITKNC33 
AITKNC31 
AITKNC32 
AITKNC33 
AITKNC34 
AITKNC35 
AITKNC36 
AITKNC37 
AITKN08 
AITKNC39 
AITKNC4C 
AITKNC41 
AITKNC42 
AITKNC43 
A  I TKNC44 
AITKNC45 
AITKN046 
AI TKNC47 
AITKNC48 
A  ITKN049 
AITKNC50 
AITKNC51 
AITKNC52 
AITKN053 
AITKNC54 
A I TKN055 
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tu-i. 

22 ZC  IF  MUI-LU.FC.l)  GO  TC  14' 

L I  * ( LL  +  LU) /? 

IF  (Xl-XUIM  2430, 170C,  2503 
240C  LL  =  L I 

r,C  TC  2 TOG 
250C  LU  =  L I 

GO  TC  2 2  0". 

14C'  Y  - 1  L 
Lu  £  =2 
280C  K l * K 

IF  (INT.'C.C)  RETURN 

IP5=f 

XX( J I  =  X ( K  >  -  X  I 
YY(  J » *Y  C  K  > 

290C  IPS  =  IPS  +  1 
3CCC  J  =  JM 

If  (J.GT.ll)  GC  TO  58. C 
IF  (J.IE.M  GO  TC  3730 
58GF  J*J-1 

Y I  *  YY ( J 1 
CIF=CIFF( Jl 
RETURN 

3 7 C  C  GC  TC  (3R.:C.4i:C.  3903, 4230), IRS 
380C  l  R  S  =  2 
3S0C  K  =K - 1 P  S 

IF  (K.CT.C)  F 0  TO  4520 
IF  (LHS.EC.3I  GC  TC  582  3 
4COC  K  =  K-*  I  PS 
IP  S  -4 
IP's'. 

GC  TC  37'' 

4 IOC  l“S*l 
42CC  K  =K  4  I P S 

IF  lK.Lr.M  GO  TG  4830 
IF  (LKS.GC.4K  GC  TC  58C  3 
4  3CC  K  *  K  - 1  P  S 
LRS  =  3 
1  P  S  S1 

GC  TC  3703 
450C  XX ( J)»X«KI-X I 

YV( JI*y(K| 

LD* J-  1 

r;p  4fco  i-i.Lu 
Tl  =  XX ( JI-XX (  I  ) 

IF  (Tl.NE.  ‘  .  )  GC  TC  4 6  )3 
KPITE  (6,31 

3  FORMAT  <27F*r,mSlCN  BY  /  ERG  IN  MTKGN) 

WRITF  (6,11  XI ,Kl,J,(X(Z) ,Y(Z ) ,  2  * 1 , N ) 

I  FORMAT  (1HC»1PE2G.6»2I19/1X/(1X,IP2E29.6M 

cut  FXCM 

463C  YY  C  J» »  (  *  YV  ( I  )*XX(  J))-(YY(  J)*XX!im/Tl 
CIFFI  J>=ABS IYY( J)-YY( J-l II 
IF  (CIFFI  J).GC.riFE(J-in  GO  TO  590, 

IF  (K.LT.KH  Kl=K 
IF  (2-LRS)  330:, 2903,2900 


Al TKNG56 
A I TKNC57 
AITKNG58 
A I TKKC  59 
AITKNC60 
AITKNC61 
Al TKN-62 
AITKNC63 

A1TKNC64 

6ITKNC65 

A I  TKNC66 

A  1  TKNi.6  7 

Al  TKNC'68 

AITKNC69 

AITKNC70 

AITKNG71 

AITKNC72 

AITKNC73 

AITKNC74 

AITKMC75 

AITKNG76 

AITKNC77 

AITKNC78 

Al  TKNG79 

Al  TKNCbu 

AITKNC81 

A I TKNC82 

AITKNGG3 

A I TKNL  84 

A1TKNCB5 

A  I TKNC86 

AITKNC07 

AITKNC8B 

AITKU.E9 

AITKNG90 

AlTKNCSl 

AITKNG52 

AITKNC93 

AITKNC94 

AITKNG55 

AITKNG96 

AITKNC97 

AITKNC98 

AITKNG49 

AITXN1C0 

AITKN1C1 

AITKN1C2  123 

AITKN1G3 

124 

AITKN1.4  130 

AITKN135 

Al TKN  1 J6 

AITKN107 

AITKNI08 

AITKN1C9 


GL  TFRE 

A  I  TKN 


EFN  SOURCE  STATEMENT  -  IFNIS) 


: 7/14/69 
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APPENDIX  IV 

FORTRAN  PROGRAMS  FOR  A  SAMPLING  RATE  STUDY 


Preceding  page  blank 
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PfVl!  V  -  t'ffJ  SOURCE  STATEMENT  -  IFNIS1 


10IHENSICN  ARAV(‘17rc, | 

ri  IVFNSTCH  TEP»(12) 

OIMENSION  A(120,9),(l< 1 2 , 25  )  . E VN1< 50 > , XCNT  <  50 ) .DEL ( 10 ) 

DJMFHSICN  ARK/ ( 50 ,  1C 1 , AP  I  50, 1  1,12) ,«PTCT(5C  1 
0  I  T  CN  I RT F I  50  * • SUM  II  2  1 

COCHIN  AR  AY , DELTA ,V,RF SOL, CCLNT,rf,TKFEP,L 
CFMWON  TERR 

R  EACt  5,  5-1  r  )l\,  ",  I  MEM,  f  RAY  ,  I  Yp 
WRtm6,lCC0)  1MCN.ICAY,  IYR 
WRlTF(6,l?C3t 

IV1’  F ORM  AT (  1  3 H  VAR  15  RITCH/1H  /) 

REAC(5,51I  MEVMHI  11,1-1,  Ml 
BEAC(5,531»UCNT(  I).I=1,N) 

REAL!  5.  =12  MDCl  (1),  IH  ,M  1 
R  EAOI  5,730)1  JRTFf  I) , 1 =1 ,n| 

75  a  FORMAT! 14! 5) 

5F-)  FORMAT!  51  5  1 
50  1  FORMAT! l2F5.lt 
5n  2  FORMAT!  I?  F  f  .  ?  J 
5<A5  =ORMAT(  EF3.4  t 
W  R I  r  F  ( 6 ,  t n  C  1. 1 
DO  20  I =1  ,  A 

2?  REACH  M(<A!IY,JY),IY-1, 120  ),JY  =  l,l> 

READ!  16)1  (  8  (  1  Y.JY  »,  IY  =  t  ,12  )  ,  JYH.251 
on  21  JM  ,  12 
X-AM01'  [)(  J  ,  15  I  ,  1 C' C .  n  > 

IFIEVN0I1  )  -XI 21,  1,21 
21  CONTINUE 

on  to  7? 

1  I  A=  1 

V)  REACU6M  (  A  I  l  Y.JY  »,  T  Y=  1  , 1211  ,JY  =  1 ,91 
REA0H6K  (fUIY.JY1,  IY=1,12)  ,JY  =  1,251 
10  5  K*l,  121 
TFtK-imi  ,101,110 
105  1 F ( A  (  K ,  6 1  1510, SOI, SCI 
50  1  1  F( A(K,fc)-2SC . *  512,  502, f 00 
rot  I F( AHSf  A(  K , 2 1 1-36C. 1 RC3 ,3 11, eoi 
511  IF!  P(K,M  1  3C0, 300,101 
502  ARAY!  m-AR«Y(  16-1  ] 

GO  TO  5 

111  AP.AY!  !A!  =  A|K,  1  1 
5  I  A*  I  AM 
X  * !  A  / 1  o 

IF( X-XCNT (  I  1  >12,6,6 
6  I  A= 1  A- l 
RFSCL=o. 

HR!TE(61lr 10) 
mi  E-nR m at (  ih  / ) 

10  52  K=1  ,M 
OFLTA--O.11 
7  =OEL ( K  1 

l  =  r  a 

CALL  TST°  E 

IV'l  FORMAT  T  VH  1 , 5X  ,  I’HSAMPL  1  AG  ANALYSIS  FOR  FLIO.HT  OF  12  ,  IH-I  2  t  IH-I2/ 
1!H  /) 


03/26/70 
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03/26/70 

RESOLV  -  FFN  SULPCE  STATEMENT  -  IFN!S)  - 

I'm  FORMAT!  1H  .5X.4HSAMP,  ?X,  3HNC.,  6X,  UHTIMES  M0PST/32H  EVNO  RATE  SAMP 
1  RES.  EXCEC.  ERR,4X,4HTIME,2X,4H0-.5,1X,66H.5-1.  1-1.5  1.5-2.  2-2 
2.5  2.5-3  3-?. 5  3.5-4  4-5  5-10  10-20  GR-20/1H  /> 

WR1TEI6.1CC2 I EVNO  t I  I ,  V , L , RFSCL ( COUNT , W , TKEEP ,  ( TER R !  KL) ,KL=1, 12) 
inn?  FORMAT! F4.0,F6.2,  !5 , F5. 1 ,F6. 0, F 5. 3 ,Ffc . 2, 1 2F6.0) 

ARX7!  I  *  K ) =C0UNT 
AR!  l,K,ll=TERRUI 
no  400  KL  =  2 , 1 2 
KM=KL-1 

60  0  AR!  I.K,KL  MAR!  I,K,  KM  I  ♦  TERR  IKLI 
50  CONTINUE 
A  RTCT  ( I  I  =  L 
20  CCNTINUF 

00  602  1=1, N 
fin  602  J=  1 ,  M 
00  601  K=l,12 

601  AR! IfJ.KI'AP! I,J,K)/ARXZ(!.JI 

602  ARXZU,  J)  *ARXZ!  I,  JI /ARTCTII) 

WRITE!6,6C2  I 

00  605  1=1,  N 
WRITEI6.6C7I 
00  604  J= 1 ,  M 

HRITF(6,6C6IEVN0!  II .DEL ! J I , ARXZ < I , J I , ( AR ( I , J ,K ) ,K  =  1 , 12  I 
504  CONTINUE 
605  CONTINUE 

603  FORMAT! !H  /IH  /6H  EVNC , 4X, 3M0EL, 4X ,4HG T  C,4X, 

15HLE  .5 ,3 X , 5HLE  l.,2X,6HLE  1.5,3X,5HLE  2., 

2?  X , 6HLE  2 . 5, 3  X , 5HLF  3..2X.6HLE  3.5.3X, 

35MLE  4.,3X,5HLE  5.,2X,5HE  10, 

43X.6HLE  2 C  ,  3X , 6HL  E  INF/1H  / I 
406  F0RMAT(F5.C,2X,F6.2,2X,F6.1,2X,12IF6.3,2XI) 

607  FORMAT! 1H  /) 

00  750  LM*1,3 
DO  752  J=l,M 
WRITEI6.6C7) 

00  751  LX  =  1 , 1 2 
751  SUM  1  LX  I =0  . 

00  753  1=1, K 
t  MT=IHTF!  I  » 

IF! IMT-LM|763,754,753 

754  00  755  K=l,12 

755  SUM(KI  =  SUM(KI*AR!  I, J,KI 

WRITE(6,6C6IEVN0(  I)  ,DEL ( J I , ARX Z Cl , J) , I AR t I , J ,K I ,K= 1 , 12 » 

753  CONTINUE 

WRITE(6,78CMSUM(KI  ,K*1,12) 

780  FORMAT! 23X, 12IF7.3, IX  I  I 
75?  CONTINUE 
750  CCNTINUE 
STOP 
FNO 
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TST 


PFN  SOURCE  STATEMENT  -  !FN(S> 


03/26/70 


S iJfi**nUT  IN E  TSTRE 
OI^FNSICN  ARAY(97C0) 
n I M  FN  S I CN  TFP«<121 
0  1  MEN'  SION  ANUMI13I 

rCMMl'l  AR  AY,r)FLTA,V,KESCL,CCUNT,W,TKFFP,L 
fOMMriM  TFRP 

nn  1  1  =  1,  1  ? 

I  TERP(l>=0. 

a  nu  m ( n  =o . 

00  2  1=2. H 

0  ANU',(  I  I  =  AM>  ll-ll ♦  .  5 
A  NU  Y ( 0 ) =4  • 

ANUW( K )=c . 

A N'J Y (  m=  10. 

ANDY (  IP  1=20. 

ANUy<  1?  1=  1  00r  0 . 

TKFPP=-  1.0 

w  =  -l  -'or  . 

3=V/nEL  TA 

CCUNTaO.o 

L  F T  =  l-w 

00  23  J=l,LET,M 

p  1=  ARAY  (J  1 

YT=J»M 

P?=«RAY(KT  1 

1M*=J-1 

T l=rM«»0ELTA 

0  MM  sK  T—  1 

T  7  =  CYP* HE  L  TA 

xmL»(P2-P1)/(T?-T11 

XIS=P1-XRI*T1 

K  AX=J4-1 

K  AY  =  J  *M-l 

00  «I=KAX,KAY 
I1MR  =  1-1 
T=CYP*DFLTA 
T  CS  T  =  XRL*  T  +XLS 
X  =  AP AY (  H-TEST 
XX=AflS(XI-°ESCL 
1 F( XX14.4.E 
0  CnuNT  =  CCUM  +  l  .1 
00  7  K«l, 12 
l  F(  XX-AN'JY  (  K  l  13, 3 , 30 
7 0  I  F(  XX-AKUY  (KM)  132.  32.3 
37  TFRP1K)=TERR<K)«-1  .0 

3  CONTINUE 

I  F(  XX-V.  ,4,6.6 
6  W=XX 
TKFEP=T 

4  CONTINUE 
20  CONTINUE 

RETURN 

END 
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APPENDIX  V 

EXTENDED  ANALYSIS  OF  THE  NORMAL  LANDING  TASK 
J.  F.  Hixson,  Lt  Colonel,  USAFR 
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1.  INTRODUCTION 

Measurement  analysis  of  the  360°  overhead  traffic  pattern  involves  a 
sequential  examination  of  the  individual  and  combined  aeronautical  and 
procedural  skills  incorporated  in  this  maneuver.  For  purposes  of 
interpretation  of  data  and  analysis  of  skills  involved,  the  flight 
maneuver  is  broken  into  eight  phases.  This  maneuver  conforms  to  the 
360°  standard  overhead  pattern  for  the  T-37  as  outlined  in  ATC  Manual 
51-4,  (Reference  4). 


The  eight  phases  are  as  follows  (See  Figure  A): 


IA 

Entry 

IB 

Approach  to  Runway  (Overhead) 

II 

Initial  Overhead  to  Pitchout 

III 

Pitchout  and  First  Quarter  Turn 

toward  Downwind  (0°  to  90 

turn) 

' 

IV 

Second  Quarter  Turn  to  Downwind 

(90  to  180°  turn) 

V 

Downwi nd 

' 

VI 

First  Quarter  Turn  to  Final  (180  to  270°  turn) 

VII 

Second  Quarter  Turn  onto  Final 

(270  to  360  turn) 

VIII 

Final  Approach 

2.  DISCUSSION  OF  MANEUVER  SEGMENTS 

a.  Phases  I A  and  B,  Entry  and  Approach  Phase  of  Normal 
Overhead  Pattern  (See  Figure  B) 

The  student  discerns  a  heading  that  is  45°  to  the  heading  of  the 
active  runway  (the  runway  to  be  landing  on).  He  approaches  the  field  on 
this  heading  at  an  altitude  of  1000  feet;  airspeed  200  knots;  RPM  80% 
(approximately)  to  a  point  where  his  45°  turn  will  place  his  aircraft  on 
a  flight  path  that  wiTf  begin  at  least  two  miles  from  the  approach  end  of 
the  active  runway  and  on  a  ground  pattern  that  would  describe  a  line 
directly  down  the  center  line  of  the  runway. 
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Figure  A.  Task  Segments  for  360°  Overhead  Landing  Pattern 


Approach  Phases  of  360°  Overhead  Pattern 
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b.  Phase  II,  Initial  Overhead  to  Pitchout  Phase  of 
Normal  Landing  (See  Figure  C) 

The  student  maintains  an  altitude  of  1000  feet;  200  knots; 

RPM  80%,  to  a  point  at  least  3000  feet  beyond  the  approach  end  of  the 
runway,  and  not  beyond  the  halfway  mark  of  the  runway.  Some  where 
within  this  region  the  student  executes  his  pitchout.  At  pitchout,  he 
banks  the  aircraft  (not  over  60°)  and  retards  his  throttle  setting  to 
one  of  50-60%  RPM  while  maintaining  pattern  altitude  (1000  feet!. 

c.  Phases  III  and  IV,  Pitchout,  First  and 
Second  Quarter  Turns  to  Downwind  of  Normal 
Overhead  Pattern  (See  Figures  D  and  E) 

The  pitchout  initiates  a  continuous  180°  turn  by  the  student, 
with  consideration  given  to  wind  conditions.  When  properly  executed, 
rollout  will  be  accomplished  at  a  point  even  with  the  pitchout 
initialization  point  and  on  a  parallel  path  to  the  active  runway.  This 
part  of  the  flight  path  is  called  the  downwind  leg.  Throughout  this 
turn,  an  altitude  of  1000  feet  is  maintained.  Additional  back  pressure 
(hence  trim)  is  needed  to  maintain  the  altitude  because  of  the  decrease 
in  the  power  setting  at  pitchout  (50-60%). 

d.  Phase  V,  Downwind  Leg  of  Normal  Overhead  Pattern 
(Figure  F) 

As  rollout  on  the  downwind  leg  is  accomplished,  the  student 
lowers  the  speed  brakes  to  reduce  the  airspeed  to  150  knots  or  lower. 

As  the  aircraft  passes  below  150  knots,  gear  is  dropped  and  airspeed 
continues  to  drop  off.  Throughout  these  operations,  an  altitude  of 
1000  feet  is  maintained  and  increased  power  setting  may  be  necessary  to 
hold  airspeed  and  altitude.  An  altitude  of  1000  feet  is  maintained 
throughout  the  landing  pattern  through  the  point  of  flap  lowering.  At 
no  time  on  the  downwind  is  the  airspeed  permitted  to  drop  below  120  knots. 
(Increased  power  setting  may  be  necessary  as  drag  increaes  to  maintain 
airspeed  and  altitude.) 
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Pitchout  Point 


i 


Altitude  IOOO  ft 
Airspeed  200  Kts 
RPM  80%  (Approx.) 


More  Than  3000  ft  Out 
Less  Than  Haifway 
Down  Runway 


Figure  C.  Initial  Overhead  to  Pitchout  Phase  of  360°  Overhead  Pattern 
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Figure  E. 


2nd  Quarter  Tur )  to  Downwind  Ph.'su  of  ooU''  Overhead  Pattern 
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Figure  F.  Downwind  Phase  of  360°  Overhead  Pattern 
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e.  Phases  VI  and  VIII,  First  and  Second  Quarter  Turn  to 
Final  Phase  of  Normal  Overhead  Pattern  (Figures  G  and  H) 

A  descending  turn  is  initiated  with  a  decrease  in  airspeed  to 
110  knots.  The  student  takes  into  consideration  the  wind  and  distance 
from  the  runway  so  that  rollout  will  be  made  at  a  predetermined  position 
at  least  one-half  mile  from  the  end  of  the  runway  with  an  altitude  of  at 
least  300  feet.  At  no  time  is  the  bank  to  be  over  45°  or  the  airspeed 
to  be  less  than  110  knots. 

f.  Phase  VIII,  Final  Approach  Phase  of  Normal 
Overhead  Traffic  Pattern  (Figure  I) 

The  student  will  rollout  on  the  final  approach  at  least  one  half 
mile  from  the  approach  end  of  the  runway  at  an  altitude  of  no  less  than 
300  feet.  The  rollout  should  be  at  such  a  heading  as  to  result  in  a 
ground  path  in  line  with  the  runway.  Airspeed  is  lowered  to  100  knots 
during  the  final  approach  and  letdown. 

3.  NARRATIVE  DESCRIPTION  OF  THE  360°  STANDARD  OVERHEAD 
TRAFFIC  PATTERN  AS  OUTLINED  IN  ATC  MANUAL  51-4* 

Entry  into  the  landing  pattern  is  initiated  at  a  45°  angle  to  the 
active  runway.  All  turns  in  the  maneuver  are  in  the  same  direction, 
depending  on  whether  the  pattern  is  a  right  or  left  hand  pattern.  Initial 
pattern  altitude  is  1000  feet  and  pattern  airspeed  is  200  knots 
(approximately  80%  RPM). 


Initial  leg  of  landing  pattern  is  in  line  with  and  over  the  center 
line  of  tfie  active  runway. 


After  a  position  between  3000  feet  from  the  approach  end  of  the 
runway  and  one  half  of  the  runway  is  reached,  pitchout  is  accomplished. 


throughout  the  entire  flight  pattern,  the  student  will  be  expected  to 
execute  coordinated  flight  maneuvers  and  evidence  a  smoothness  in  the 
execution  of  procedures.  Proper  clearing  of  area,  adjustments  for 
wind,  traffic,  and  understanding  of  necessary  cockpit  procedures  are 
assumed  within  the  realm  of  capability  and  understanding  of  the  student, 
as  well  as  the  expected  procedure  for  the  360°  overhead  standard  pattern. 
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Figure  G.  1st  Quarter  Turn  to  Final  Phase  in  360°  Overhead  Pattern 


Figure  H.  2nd  Quarter  Turn  to  Final  Phase  of  360°  Overhead  Pattern 
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Figure  I.  Final  Approach  Phase  of  360°  Overhead  Pattern 
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This  constitutes  a  nearly  simultaneous  bank  in  pattern  direction,  and 
reduction  of  power  to  between  50  and  60%.  (If  one  is  to  precede  the 
other,  bank  should  precede  reduction  in  power.)  The  bank  is  not  to 
exceed  60°. 

In  maintaining  pattern  altitude  of  1000  feet,  there  is  a  continuous 
180°  turn  designed  to  bring  the  pilot  out  on  the  downwind  leg  position 
of  the  pattern.  The  rollout  for  downwind  should  be  accomplished 
approximately  in  line  with  the  pitchout  position  to  initiate  a  ground 
pattern  parallel  to  the  active  runway.  During  the  turning  interval, 
the  pattern  altitude  of  1000  feet  is  maintained  as  airspeed  decreases, 
due  to  the  reduction  in  power. 

After  the  rollout  on  downwind  is  accomplished,  speed  brakes  are 
applied  to  bring  the  airspeed  down  to  150  knots  or  below.  The  aircraft 
should  be  approximately  one  half  of  the  way  on  the  downwind  leg.  Gear 
should  be  dropped  at  this  point,  continuing  the  reduction  of  airspeed 
to  135  knots  or  below  (never  below  120  knots).  Pattern  altitude  of 
1000  feet  above  the  terrain  should  be  maintained  at  all  times.  Power 
necessary  to  maintain  airspeed  and  altitude  should  -be  used. 

/ 

Wing  faps  should  t  Iropped  prior  to  initiating  turn  that  will 
bring  the  aircraft  out  on  final  approach.  THIS  SHOULD  BE  DONE  WHILE 
AIRCRAFT  IS  STILL  IN  LEVEL  POSITION,  AIRSPEED  LESS  THAN  135  KNOTS,  BUT 
NOT  LESS  THAN  120  KNOTS,  AND  ALTITUDE  STILL  1000  FEET. 

Initiate  continuous  turn  onto  final  approach;  bank  is  not  to  exceed 
45°.  Nose  is  lowered  to  begin  descent,  and  airspeed  is  decreased  to 
110  knots  in  the  turn.  Turn  and  descent  is  judged  to  permit  aircraft 
to  rollout  on  final  approach  at  least  one  half  mile  from  the  end  of  the 
runway  at  an  altitude  of  NOT  LESS  THAN  300  FEET. 

A  straight  descent  is  maintained  until  touchdown.  Airspeed  is 
decreased  to  100  knots  for  final  approach. 
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4.  Skills  Required 

Mastery  of  the  360°  Standard  Overhead  Traffic  Pattern  is 
mandatory  prior  to  a  student's  ability  to  fly  an  aircraft  solo.  The 
skills  involved  in  this  maneuver  will  have  been  presented  t  the  student 
as  individual  skill  techniques  prior  to  accomplishment  of  the  landing 
pattern.  Measurement  of  the  basic  skills  are  of  prime  importance  in 
ascertaining  proficiency.  The  skills  in  mention,  and  the  areas  of  the 
maneuver  in  which  they  are  employed,  are  defined  as  follows: 

Directional  Control.  The  skill  of  being  able  to  determine  and 
maintain  a  heading,  determine  and  maintain  proper  ground  track  depending 
on  wind  conditions,  rollout  on  a  predetermined  heading  from  varying 
degrees  of  bank  from  level,  and  ascending  or  descending  flight. 

Altitude  Control.  The  skill  of  being  able  to  maintain  altitude, 
level  off  at  a  predetermined  altitude  either  from  a  climb  or  descent; 
maintain  altitude  with  varying  airspeed  or  with  varying  degrees  of  bank, 
and  in  a  rollout  from  a  banked  turn  within  varying  degrees  of  bank. 

Airspeed  Control.  The  skill  of  maintaining  a  desired  airspeed, 
or  establishing  a  desired  airspeed,  the  ability  to  change  an  airspeed, 
then  establish  the  attitude  to  hold  the  airspeed  as  in  a  descent,  or 
the  skill  to  establish  the  attitude  to  attain  a  predetermined  airspeed. 

Roiling  Into  and  Maintaining  a  Desired  Bank  (Without  Varying). 

The  ability  to  make  a  coordinated  turn  without  varying  airspeed  or 
altitude,  and  the  ability  to  roll  Into  and  out  of  this  turn  without 
over-controlling.  Also,  the  ability  to  rollout  onto  at  a  predetermined 
heading. 

The  ski  1 1 -composi tes  and  knowledges  that  need  to  be  considered  for 
measurement  are: 

Straight  and  Level  Flight.  The  ability  to  maintain  the  aircraft  in 
straight  and  level  flight  involving  the  maintenance  of  heading  and 
altitude. 
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Level  Turns.  The  ability  to  make  a  coordinated  turn  without  losing 
altitude  or  over-controlling  to  maintain  proper  bank. 

Descending  Turns.  The  ability  to  maintain  the  proper  airspeed, 
bank,  and  rate  of  descent  without  excess  banking. 

Maintenance  of  Altitude  at  Varying  Airspeed  or  Power  Setting.  The 
ability  to  maintain  a  given  altitude  while  varying  the  power  setting. 

In  the  traffic  pattern  maneuver,  this  involves  reducing  the  airspeed 
while  holding  altitude. 

Straight  Descent.  The  ability  to  maintain  directional  control  of 
the  aircraft  while  losing  altitude  at  a  given  airspeed  and  a  constant 
glide  angle. 

Varying  Degrees  cf  Bank.  The  ability  to  coordinate  a  roll  into  the 
desired  bank  and  maintain  this  bank  without  loss  of  altitude,  unless  so 
desired.  Also,  the  ability  to  determine  and  hold  a  prescribed  degree 
of  bank. 

Ability  to  Judge  Rate  of  Turn.  The  ability  to  predetermine  the 
position  to  initiate  a  given  rate  of  bank,  or  alter  a  rate  of  bank 
within  limits  in  such  a  manner  that  the  rollout  places  the  aircraft  on 
the  desired  ground  path. 

Ability  to  Rollout  Onto  a  Desired  Heading.  The  ability  to  place 
the  aircraft  on  the  desired  heading  after  completion  of  a  turn. 

Ability  to  Determine  Wind  Drift  and  Angle.  Basic  knowledge  of  wind 
and  wind  drift  angles  that  permits  rolling  out  to  a  predetermined  heading 
that  will  effect  the  desired  ground  path. 

Knowledge  of  Procedures.  Basic  knowledge  of  aircraft  procedures 
for  landing  and  for  the  larding  pattern  that  will  produce  desired  changes 
in  airspeed,  altitude,  direction,  etc.,  at  the  prescribed  position 
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in  the  landing  pattern  are  essential  to  accomplish  the  landing  pattern 
as  prescribed. 

The  student  is  expected  to  execute  coordinated  flight  maneuvers  and 
demonstrate  a  smoothness  in  the  execution  of  procedures  throughout  the 
entire  flight  pattern. 

5.  PRELIMINARY  PERFORMANCE  MEASURES  FOR  THE 

NORMAL  OVERHEAD  360°  TRAFFIC  PATTERN 

Patterns  will  present  different  profiles  because  of  the  different 
procedural  requirements  due  to  such  variations  as  single  engine  landings, 
touch  and  go  landings,  right  or  left  hand  patterns,  and  patterns 
executed  with  varying  degrees  of  flaps.  In  general,  measures  should 
address  at  least  the  following  parameters: 

Altitude.  Measurement  of  how  well  the  pilot's  altitude  compares 
with  ATC  criteria  throughout  the. maneuver.  Measures  ability  to  maintain 
altitude  through  different  power  settings,  while  accomplishing  cockpit 
procedures. 

Airspeed.  Measurement  of  how  well  the  pilot  remains  within  the 
ATC  limits  as  he  follows  the  normal  procedure  for  the  landing  pattern. 


Degree  of  Bank.  Measures  the  pilot's  ability  to  accomplish  a  180° 
turn  without  exceeding  a  given  maximum  bank,  and  his  ability  to  judge 
the  necessary  angle  of  bank  needed  to  complete  the  turn  within  a  certain 
area,  rolling  out  at  a  prescribed  position  on  a  definite  heading. 

Vertical  Velocity.  Measures  the  ability  of  the  pilot  to  transition 
from  level  flight  attitude  to  a  descending  attitude  and  to  anticipate  the 
required  rate  of  descent. 

Attitude.  Determines  the  pilot's  ability  to  hold  altitude  by 
changing  the  attitude  at  different  power  settings. 
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RPM.  Measures  how  well  the  pilot  conforms  to  ATC  standards  and 
procedures  throughout  this  maneuver  for  either  normal  or  single  engine 
performance. 
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APPENDIX  VI 

EXECUTIVE  PROGRAM  FOR  LAZY  8 

This  program  reads  the  calibrated  data,  performs 
basic  computations  (estimated  ground  speed, 
altitude-change,  and  degrees  of  turn),  prints 
data  at  a  sampling  rate  of  2/second,  calls  the 
measurement  subroutine,  and  generates  plotting 
data. 
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KUtiOP 

LAZYYd  -  EFI^i  SOURCE  STMEMENT  -  IFN(S)  - 


CPRINT  MEtSUrxc  VARIABLES  FUR  LAZY  8  MANEUVER 
DIM  NS I  ON  AR ( 10 1 8  3  A I 
01  MENS  1  ON  4(120,9) ,U( 12,25),  E  VNO( 25  I 
DIMENSION  XCNTI25) 

DIM  NS  I  ON  ZX(120),ZY(120),nATA{43B) 

COMMON  AR,L 

CALL  PLGTS(04TA,438) 

CALL  PLOT ( 0 « 0 , 0. 3 , -3 ) 

I  COUNT  =  4 
I EV-  1 

REA1)  15,500)  N 
READ  (5,501)  (EVNOU >.I*l,M 
601  REAU  (5,501)  (XCNT ( I  I , I- l ,N) 

ITEiT=-10 

1  REAL ( 16  I  (<A(i,J),I*l,120),J«l,9) 

REALM  16  I  ((B(I,J),I  =  l,12),J  =  l,25) 

00  20  1=1,12 

X':AMOU  (0(1,181,100.0) 

IF(tVNOUEV)-X)  2,3,2 

3  IF  (  ITEST  )  4,5,5 

4  WRIT’  (6,300)  EVNO(IEV) 

L  =  0 

TIME-0.0 

I  TEST  =  G  .  ..... 

5  I  A  =  10*( l-l >*l 
L  =  L*1 

AR  (  1 ,  L  )  =  A  (  I  A  ,  2  ) 

AR(2,L)=A(IA,1) 

AR(3,L)=B( I ,7) 

AR ( 4 , L ) =B ( 1,6)  _ . . 

AR(5,L)  =  A( 1  A , 6 ) 

AR ( 6 , L ) =B ( I  ,  15 1 
AR(7,L)=B( 1 , 16) 

AR ( 0 , L ) = A ( 1A,3) 

AR(9,L)=A( I  A, 4) 

AR  ( 10  »L )  *3(  1 ,9 )  ....  .  .... 

ANL=3. 141 59?65*AR( 2, L 1/180.0 
SXLR  =  SI N( A  |L ) 

CXLK=COS ( ANL I 

ALTX=SXLR*AR(5,L 1*6080.0/3600.0 
GS=CXLR*AR(5,L) 

TURN=ABS(AR(3,L)-AR(3,1)  I 
IF ( I  COUNT-4)  201,200,201 

200  WRITE  (6,301)  TIME , A U A, 2 1 , A (1 A, I ) , B ( I ,7 » ,8 1 1 , 6) , At  I  A, 6 ) , B ( 1 • 15  ) , 
1B(I,16) ,4(1 A,3),AI I  A, 4), TURN, GS, ALTX 

TIMt-TIME+0.5 
ICOUNT  =  0 

GO  TO  600  .  . 

201  I  COUNT  =  I  COUNT-*  1 
GO  TO  600 

2  IFUTESTI  20,7,7 
7  CONTI NU " 

CALL  ELAZY8 

RE  AC ( 5 , 500 ) IVPLOT 

IF  ( 1  VPLIjT  1 700,82,82 
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KNbflP 

LA/YY3  -  t  F  M  SOURCE  SLAT  EME'JT  -  IFNISI 


10/13/69 


CSTART  PLuT  KUUTI  l~ 

32  KK- 

00  >0  IK*1,L,10 
KK  =  KK  +  1 

ZX(KK)*4R(1,IK) 

90  ZY(KK)=4P(2, IK) 

CALL  SYMB'JL(-0 .6,- 1. 1  ,C.  1  ,23HR0LL  VS.  PITCH  FUR  LAZY  8,0,25) 

CALL  SCALE!ZX,10.0,KK,1, 10.0) 

CALL  SCALEI7Y, 9. 0,KK, 1,10.0) 

CALL  HfltUX.ZY.KK, 1,1,11  | 

I  C!hL^^<ISn‘0,°*  1<fHR0LL  {  3E9r^S»  *-14, 10.0,0.0, ZXIKK+ II ,ZX( KK*2) 

l f 1 0  #0  I 

C^)-4  ^XIS*0*0»0-0»  liHPITCH  (DEGREES  )  •  1 5 ,9.0 ,90 . 0,  ZY  (KK  +  1 ) ,  Z  Y  ( KK*2  ) 

i  t  1  J  •  U  I 

zxm=u. 

ZX ( ? ) =40. 

ZX(."|*fcC. 

ZX(4)=40. 

ZX(. )=C, 

\MX=O.U 
00  41  LA-1, KK 
V*ABS(/Y(La) ) 

IF ( V-AMXI91 ,91 ,92 

92  4MX-V 

91  CONTINUE 
Z  Y I  11=0. 

Z  Y  (  2  I  =  *.  M  X 
ZY( ,) =0. 

ZY(4 )=-4MX 
Z  Y (  1=0. 

00  93  L 4=6, 10 
LR=l 4-5 
Z  X  (  L  A  )=-ZX(LB) 

93  Z Y  (  L  A  I  =  ZY  ( LH  ) 

ZX( 1 1  )  =  ZX(KK+l ) 

ZX ( l?)=7X(KK+2) 

ZY(  1  1 } =ZY ( KK ♦  1  ) 

Z  Y  (  1 2  1  =  ZY ( KK+2  1 

CALL  LINE(ZX,ZY, 10,1,0,0) 

94  LI.  PLOT (ti. 0,0. 0,-3) 

KK  =' 

99  44  1 K* 1 , L , 1 0 
KK  =  KK ♦  1 
ZX(|\K)=KK 

94  ZY ( KK )  =  iR I  1 , I K  ) 

CALL  SYMBOL  (-0.6, -1.1, C. 1, 34HRULL  A,,D  PITCH  VS.  TIM;  FOR  LAZY  .4,0, 
134) 

c*aLl  so  le(zx,io.o,kk, i, io.oi 
CALL  SCALEIZY, 9. O.KK, 1,10.0 
CALI  LI  ).  (  ZX ,  Z  Y , KK ,1,1,11  ) 

CALL  A  X  I  S  (  j. 0,0.0, 14HTIME  (SEv-ONDS)  ,-14,10.0,0.  ),ZX(KK+  l ) ,  ZX  (KK,?  ) 

i  ,  1  j  .  9  ) 

-ALL  AXISIO. 0,3.0,  7H0LGREE $ , 7 , 9 , 0,90 .0 , ZY(KK+ll»7Y(KK +21,10.0) 

KK  s  l 

D9  4r  IK  =  1,L,  10 
KK  =KK ♦  1 
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KM,  UP 

L  Z  Y  Y 11  -  tF(  S'lUR^r:  STATCMlVT  -  I  F  1 1  0  ) 


10/1  3/69 


9  5  ZY  (F K  )  =  AK(  2,  IK  I 

CALL  L  1  •  (  ZX,ZY,KK.  ,i  ,  1  , 1  ) 

CiLt  S  Y  M ft 0 l  (  B .  C  ,  1 .  1 , 0 .  1 ,  A  H 1 lM L L ,  0 ,  4  > 

CALI  S  YMft  JL  (  8 .  7 , 8 .  a  ,  0  .  1  ,  l  1 , 0  ,  - 1  I 
call  SY”FIJLt0.d,9.5,9.  1 , 5 HP  ITCH,  0,5  ) 

CALL  SY-'POLI  8.7,3.  5,0. 1.  1,0, -l I 
KK*.. 

m  v*  ik*i,l,io 

KK  =  ►  m  1 

96  7  Y  <  F  K )  =  .»( u,  |K) 

CALL  PLr.TU?, o,. 1.0,- it 

Oil  SVMIOLI-O.o.-l.  1 .0. 1, 2iH«LT  ITliuE  VS.  TIR;  FOR  LAZY  3,0,23) 
CALL  SC  '•LS(ZY,9.0,KK,  1  ,  19.0  ) 

CALl  LI M'l/X.z Y,KK,  1,1,11 ) 

CALL  i.' 1  >(-•.?■, 0.0, 14HTIM'  U.  wONOSI  , -1  <t ,  10 .0, 0  .  ,  IK  (  KK  +  1  1  ,  L  X  (  KK«  2  ) 

i ,  n .  ■* » 

CALL  AXIS t  3.0, j.O, IsHALT!  T  Ui/t  tPEd  )  ,  1  5 , 9. 0 ,90 . u, ZY ( KK*1  )  .ZYIKM2I 
1,10.01 

KK  =  ../ 

DO  9  7  I  «*  1,1,10 
KK  =  K  K  +  1 

97  ZY(KKI=AP<5,IK) 

CALL  PLOT  (  12. 0,0,0, -3) 

CALL  S  Y  VR  l)L  (~u,S,*1.  1,0, 1  .OoHAlRSP^cD  VS.  TI  Re  FOR  LAZY  8,0,23) 
CALL  SC.vL_(/Y,9.0,KK,l,10.j) 

CALL  LI MCIZK.ZY.KK, 1,1,11) 

CALL  AX  I  S  U.  0,0.0,  UHT  IRE  (  s  Z  -  J  IDS  I  ,  - 1  A  ,  1  0 . 0, 0  .  Z  X  (  KK  +  1  )  ,  Z  X  (  KK4  2  ) 
1,10,0 

CALL  AXIS  (0.0, 3.0,  IOIIhIRSPC  :D  (KiMJTs  ),  16 , 9  .  j,  90.0 ,  Z  Y  ( KK  ♦  1  )  ,  ZY  (  KK*  2 
11,1  ■  L  I 

KK  - 

DO  A  6  l K  =  1 , L , 1 0 
K  K  =  K  K  ♦  1 

93  Z  Y ( K K  )  -  . R ( i , t  K  ) 

CALI  PLOT (  12. 0,0. 0,-3) 

C-ALl  i  Y  v  R'JL  t  .  6 ,  ~  1 .  1,  .  l.zZHHFAIUN',  VS.  TIME:  FlR  LAZY  6,0,211 
CALI  SOLSI/Y, 9.0,  KK, 1,10.01 
CALL  LI.  ( ZX , ZY, KK ,  1  ,  ,  .  1  l  ) 

CALI  AXIS!  J  .OC.9, 1-tHI  I'A-  1  ^CDMDS)  .  -1  4, 10.0,0.  -  ,ZX(KK»  1)  ,ZX(KK«2) 
1,10.0) 

CALl  AA1SU  .0,0.0, 17HH  ATI.o  (Q_GX‘  S)  ,  17,  9 , 0, 9  j,  0 ,  Z  Y  (  KK  ♦  1  )  ,ZY(KK* 
121,10.01 

CALL  PL  i7(  12.0,0.0,-31 
Z  X (  1) -  0 . c 
/YU)  =r  ,o 
KK=  I 

;n  o  i ). =  i ,  i  ,ij 

KK  -KK+ 1 

AT'.lS  *  j  .  1  A  1  A92o5*«'.h  (  3,  IK)/t»C. 

SXX*S I  M  (  AAlOL'  ) 

CX  X  =  C. US  (  AMGL-  ) 

A  M  j 1  =  J  .  I A  139265*  AR  ( 2  ,  IKI/l-lj. 

CS  =  P(S,  IK  )  *COS ( AMGb ) 

ZX(KK ) = / X ( K  K  —  1 ) +GS*sXX 
8C  ZYUK  I  =/Y(KK-l)*GS*CXX 

CALL  SY  'POLI-0. 6,-1.  I,  0.1,2.  HOROUYb  TRA^K  FIR  1.  .ZY  8,0,23) 


310 


AFHRL-TR-72-6 


K'dOP  1C./13/C9 

LA Z YY  J  -  £F0  SCUR  C  c  STATEMENT  -  If'llS)  - 

CALL  SCALEIZX,  9.  O.KK,  1,10.0) 

CALI  SCALE  I /Y,9.0,KK,1 ,10.^1 
CALL  LICr(ZX,ZY»KK,l,l,14) 

CALI  SYMH'JL  (4. 5, 9.  2,0.1.  1HM.C,  l  > 

CALL  SYMBOL (4. 2, 4. 5, 0.1,1  HE, 0.1) 

CALL  SYMBOL  (4.  £>,-0.2, 0.1, lhS.O,  1) 

CALL  $YMB(JL(-0.2,4.5,j.l.lhrf,L,l  ) 

CALL  PLOT! 12.0, C. 0,-3) 

KK  = 

on  ci  u=i,l,  io 
K  K  =  K  K  ♦  1 

7X<HK)  =  AR(‘P, IK) 

31  ZY(KK)=-AR ( P , I K ) 

CALL  SYMFt0Lt-C.o,-l.l,0.1,30HSriCK  POSITION  PlOT  F  )R  LAZY  3,0,30) 

CAL)  SCALc(ZX,10.0,KK,l,10.j) 

CALL  SCAL:(ZY, 9. 0,KK, 1,10.0 
CALL  LI*!F(ZX,ZY,KK,1,0,0) 

CALL  4X15(0, O,0.0,l')HLAT.  PJS.  (  DEGkEES  I , - 1 9,  1 0 .0 , 0 . 0,  Z X <  KK  + 1  )  ,  7. X ( 

IKK*. ) ,10.0) 

CALL  AXIS!  j  .  0 , 0. 0,  ZOMLUiTG.  P05.  (OEL»R5cS),2O,9.l,90.O,ZY(KK+1),ZY( 

IKK+2) , 1C.0) 

CALL  SYMBOL (ZX(l),ZY( 11,0.1,14,0,-1) 

CALL  PLOT! 12.0,0.0,-31 
700  CONTI  ill - 

IFdEV-  1)9,3,  b 

o  ievmev+i 
it:-ct=-io 

600  XXXrXC  ,T< IEV) 

ALL  =  L 

I  F  (  LL-XXX)20,7,7 
20  CONTINUE 
CO  TO  1 
3  CONTINUE 

500  FOR  OAT ( IS) 

501  FOR  AA  T ( 1 2F  5 , 0 ) 

300  FORMAT! 11(1 , 16HLAZY  3  NUMBER  F5.0/1H  /1H  / 56X , 4HLEFT , 3X, 5HR  I  GH T , 

1  4  X  ,  ML  )’iG.,6X,4HLAT.,2X/5H  7  l  ME  ,  4X  ,  -,H»  OLL  ,  3X  ,  5HP I  TCH ,  2  X , 

2/.HH.  A01  lC,5X  , oHALTI  TtlDS  ,2X,  RHAl  RSP.E  -0,  3X  ,  3HRPM  ,  4X  .  3HRPM ,  4X  , 

3  3r(S  T ,  PCS.  ,2X,  RUST.  P0S.,3X,4||TJRN,  3X,2H',S,5X,4il4LTX/lH  /) 

301  FOR  •ATIFF. I , 2X.F5.  , 3X , F5 . C  ,  4X , F 5 . ? , 6X , F7 . C , 5X  ,  F5 . 0 , 2X, F5. 0 , 2X , 

IF  5.  ,6X,r5,l,t,X,F5.1,2x,F5.0,lX,FS.u,IX,F5.J) 

CALL  PLOT  • 

STOP 

cNO 
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MAJOR  FUNCTIONS  OF 
BARREL  ROLL  MEASUREMENT 
SUBROUTINE 


Preceding  page  blank 
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Program 

Major  Functions 

Subroutine  Proper 

1.  Computes  maximum  and  minimum 
points  of  selected  arrays 

2.  Computes  raw  measures 

3.  Computes  scaled  combined  measures 

4.  Computes  "scores" 

5.  Calls  subroutine  "read"  and  "back" 
and  function  "amod" 

Subroutine  "read" 

1.  Reads  one  record  of  calibrated  data 
(1.2  seconds) 

2.  Places  variables  in  common 

Subroutine  "back" 

1.  Backs-up  magnetic  tape  to  the  first 
record  whose  event  number  is  specified 
in  the  calling  vector. 

Function  "amod" 

1.  Computes  roll  angle  modulo  360  to 

correct  for  instrumentation  idiosyncracy 

in  0  to  90°  region. 
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APPENDIX  VIII 

ILLUSTRATION  OF  OUTPUT  FROM 
EXPERIMENTAL  MEASUREMENT  PROGRAMS 
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MANEUVER  NUMBER  47. 


FLIGHT  OF  11-20-69 


PERFORMANCE  ANALYSIS  FOR  LAZY-8  MANEUVER 
I.  INDIVIDUAL  MEASURES 


S  HALF-1 

HALF-2 

S 

HALF-1 

HALF-2 

S 

HALF-1 

HALF-2 

1  655.81 

248.54 

7 

10.70 

-1.00 

13 

521.62 

521.62 

2  521.33 

144.52 

8 

0.20 

59.78 

14 

476.04 

476.04 

3  1.28 

3.15 

9 

5.64 

17.68 

15 

510.92 

510.92 

4  728.67 

377.83 

10 

19.63 

13.69 

16 

18.29 

18.29 

5  0. 

353.66 

11 

17.24 

3.86 

17 

0. 

0. 

6  84.14 

81.74 

12 

380.16 

380.16 

18 

0. 

0. 

19 

42.19 

46.13 

SCALED  COMBINED  MEASURES 

WEIGHTED 

MEASURE 

HALF-1 

HALF-2 

HALF-1 

HALF-2 

BANK 

81.50 

94.32 

45.51 

41.66 

PITCH 

81.77 

90.53 

45.66 

39.98 

R/C 

98.88 

97.34 

R/C 

37.94 

105.80 

AIRSPEED 

78.72 

74.91 

78.73 

79.08 

ALTITUDE 

61.73 

61.73 

ALTITUDE 

64.00 

64.00 

G-FORCE 

100.00 

100.00 

RPM 

77.64 

75.55 

II.  OVERALL  SCORES 

SCORE  HALF-1 - 

73.64 

SCORE  HALF-2» 

81.41 

MANEUVER  TIME  ■ 

72.00  SECONDS 

MAX  PITCH  1  - 

38.  MAX 

PITCH  2  -  45. 

MAX  ALT 

at 

12148.  AT 

72.  DEG 

MIN  PITCH  1  - 

-28.  MIN 

PITCH  2  -  -25 

• 

ANALYZED  402.  SAMPLES 

1st  HALF  AND  318. 

SAMPLES  2ND  HALF. 

NO.  RR  REVERSALS-  12 

NC. 

PR  REVERSALS’ 

-  28 

1.256 

0.925 

0.006 

1.537 

353.662 

165.884 

33.320 

21.095 

380.158 

521.623 

476.037 

510.923 

0.123 

9.700 

0.083 

23.325 

18.294 

0. 

0. 
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MANEUVER  NUMBER  19.  FLIGHT  OF  12-17-69 

PERFORMANCE  ANALYSIS  FOR  BARREL  ROLL  MANEUVER 


I  INDIVIDUAL  MEASURES 


S  MEASURE  S  MEASURE  S  MEASURE 

1  16693.30  7  25.82  13  13579.30 

2  14042.13  8  16.24  14  2.07 

3  3.76  9  0.  15  0. 

4  b.30  10  0.  16  0. 

5  0.34  11  1139.60  17  0.70 

6  46.37  12  434.86  18  20.04 


SCALED  COMBINED  MEASURES 


MAIN  PARAMETERS 

MEASURE 

ENTRY  AIRSPEED 

100.00 

ATTITUDE 

(1) 

44.36 

ATTITUDE 

(2) 

53.19 

ATTITUDE 

(HDG. ) 

39.36 

ATTITUDE 

(PITCH), 

75.72 

ATTITUDE 

(ALT.) 

73.76 

ATTITUDE 

(TOT.), 

79.61 

RPM 

79.28 

G-FORCE 

99.06 

ROLL-RATE 

98.66 

ATTITUDE 

(3) 

54.74 

.  OVERALL 

SCORE* 

71.99 

MANEUVER  TIME  -  25.00  SECONDS 

101.42  100.86  -99.64  104.28  100.52 
100.52  100,17  98.98  8.89  21.18 
-33.72  -47.00  3.76 
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APPENDIX  IX 

INITIAL  PLOTS  GENERATED  FOR 
NINE  LAZY  8  PERFORMANCES 


319 


PITCH  C 


•0.00 


riTxx  n.  mcwuni 


ROLL  (DEGREES) 

Plot  12 


AFHRL-TR-72-6 


ROLL  VS.  PITCH  FOR  UttT  « 


AFHRL-TR-72-6 


► 


t... 


DEGREES 

SO. 00  -70.00  -90.00  -30.00  -10.00  10.00  30.00  50.00 


AFHRL-TR-72-6 


APPENDIX  X 

STICK  POSITION  PLOTS  FOR  REPRESENTATIVE 
LAZY  8  MANEUVERS 


347 
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APPENDIX  XI 

ROLL  VS  PITCH  PLOTS  FOR  REPRESENTATIVE 
LAZY  8  MANEUVERS 


-10.00  to.oo 
ROLL  (OEGREES) 


ROLL  (OEGREES) 


«ou  vs.  firot  rar»  uwt  e 


AFHRL-TR-72-6 


-10.00  10.00 
ROLL  (DEGREES) 


-JO.OO  10.00 
ROLL  (OEGREES) 
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APPENDIX  XII 

AIRSPEED  PLOTS  FOR  REPRESENTATIVE 
LAZY  8  MANEUVERS 


Preceding  page  blank 
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APPENDIX  XIII 
PUNCH  AND  PRINT  PROGRAM 


i 


365 
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PUNCH  AND  PRINT  PROGRAM 


This  program  prints  at  At  * 

f  0.4, 


At 


0.5, 


0.5  and  punches  cards  at 
Barrel  Roll  and  Others 
Lazy  8 


Input  CrDS: 


(1)  $  Setup  A  A ( 3 )  AAAA  T37DXX,  I^RING 

(2)  Month,  Day,  Year 


(3)  N 

(4)  KODE 


+  Lazy  8 

or  other  maneuver 
o 


(5)  evno 

(6)  Duration 


M 
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KNCCP  07/ 

LA2YY3  -  EFN  SUURC-  STATEMENT  -  IFMS)  - 


CPRIM  Pr«SUKE  VAPIAet.-S  FOR  I  4/Y  6  MANEUVER 
DIVERSION  AR  (  „(>»  1500  ) 

DIMENSION  IfIK(25) 

Civ  HNS  I  ON  A( 120,9 ),B(j?, ?5),EVNOU5) 
C1VSNSION  YCNT<75) 

I CCUN  T=  4 
IEV-1 

R  S  A  C  (  5 , 5011 ) IMON, I0AY,  I YR 
5011  FCRVATI 3 1 5 ) 

RgAC  (5,50  0  N 

PHAC  (5,  J50.l1  (  Ii'IM(  1 1,  1*1, N) 

1501  FCRMATf .215) 

R  E  AC  (5,50.)  (  cVNJI  I),  I*1  ,'i) 

601  R  5  A  C  I  5 , 50 1  (  (  XCNT  (  I  ) ,  I  ■*  1 ,  N 1 
4030  CONTINUE 
I T  2  S  T  =  -  .0 

1  REACI  .6)  (  (A(  I  ,  J>,  1*1, 120)  ,  J  =  !  ,9) 

R  c  A  C  (  '.  6  )  ((B(  1,J),!  =  1,12)»J*1,25) 

CC  2C  1=1,.  ’ 

X*AKCC( P< 1,181,100.0) 

I F  <  ITcST)9710, 5,5 
97  l C  CONTINUE 

I F ( E  VNQ ( I c V  ) -X  )  2,7,2 

3  I  F (  IT;ST  )  4,5,5 

4  V>RITE(b,350)  IKON,  ICAY,  IYR 
V,RITE(6,300)EVNG(IEV) 

ICCUNT=4 

6751  In  R  I T  E  ( 7 ,6760  1  IKON,  ICAY,IYR,£VNO(  ICY) 
6760  FORMAT! 15, 15,  15, F7.0) 

6750  CONTINUE 

X  c  R  PT  =  e  VNC ( I E V  I 
L=0 

TIKt=0.0 

i TE  ST  =0 

5  I A=1C«( I-l )+l 
L  =  L  ♦  1 

6004  CONTINUE 
IF(L-i)P20, <320,321 

821  I F ( A(  IA,6) )P?2,826, 526 

826  IFIAIIA, 61--  60. 1827, 927, 822 

827  IF(  A0S(  A(  IA,  2  )  1-760.  1941.1, 941.,  322 
94ll  IF(P(I,6))t>2?,b22,e:0 

822  CC  823  M0M*1,10 

823  AR(KCK,L)*AR(KOK,L-i  ) 

GC  TC  824 

820  CONTINUE 

A  R  (  1  ,L  )  *  A  (  I A  ,  2  ) 

AR ( 2  ,  L )  =  A ( I A  ,  „  ) 

AR  (  3  *  L ) XB ( l , 7 ) 

6005  AR(4,C)*B( 1,6) 

AR ( 5 , L ) x  A  ( I A , 6 ) 

AR(6,L)=B(I,15) 

AR(7,U=e<  1, 16) 

AR(8»L)XAI IA,3) 

AR ( 9 ,  L ) * A ( I A , 4 ) 
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KNCCF 

l  A  /  Y  Y f- 


frr.  source  statement  -  ifms>  - 


4R(  1C,L )=B( I ,91 
824  CCKTIUUR 

AM  =  3  .  i4 1 59  265* ;  h  (  2  ,  L)  / :  aa .  c 
SXL  R  -  i  !  ’i  I  AM  ) 

CXLR-COSI  AM  I 

ALTX*SXLR*Ai»|  5,1.  ) • t OPG  .P/36CC . 9 
CS=CX_R»*R(5,L) 

TURMAU  i(  4K(  ■>,L  >-AR  (?,’)) 

I F  (  I CCvJ'NT-4  )  201,200, iOl 

-00  WRITEt6,?0.»TIR",AR<1,U,AR(2,LJ,AR(3,L),AR(A,UtAR(5,U,AHI6,U 
1ARC  ,U  ,  AH  (  ',0  ,  ARI  9,D  ,  TUR.N.GS,  AL  Tx  ,  AR  ( 0  ,  L  ) 

1  P'E*TIMf*0.5 
ICruAT=0 
cc  rc  boo 

201  ICCUNT*  I  COUNT ♦  1 
GC  rc  600 

2  I F ( IT. ST)  20, 7,7 

7  WRITE  ( 6, 73;  1  ) 

7311  FCRRAICH  X/| 

cr  TC  20 
7729  CCNT IMJ c 

6753  LY/X=L/5 

I  F  (  I  N  Y  (  15/  I  I  VjCO,  1C.C,  ’  -j21 
1520  A  C  E  l  =  4 

lY2Xa(L~l)/',  *2 
WRI T? (7, 5C0  11Y2X 

WRITE  (7  ,  1 52  A  I  UR<  ,  JC>  ,.*«I2,  JC)  ,4R<  j,  JO  ,  AKI4,  JO  ,AR  (  5,  JC) , 
1ARIXC  ,JCI  ,JC*.,L,<'JCEL  ) 

GC  TC  700 

1524  FCRPATIF5.0,F4.0,FS.C,F7.0,F5.0,F3.WF::.0,F4.0,F5.C,F7.0,F;.0, 

1F5.1) 

1522  M5L  =  : 

LY/X=(L-l)/5+l 
WRITU  7.50C1LY2X 

O  I T  E  (7 , 6734  )  (  (  AR(  IK  t  JO  ,  IR  =  1 ,  :  )  ,  JOE  ,  L  ,  NO 2L  1 

6754  FORMAT!  F5.0»F‘».0,FS.P,F7.0»F3. 9, F5.0,F4.0»F5.0,F7.C,F?.0,F5.Q, 

IF4,0,F‘..0,  F7.0,F5.C  ! 

6752  CONTINUE 
700  CGM  I  SUE 

IFt  IFV-NI9,  ,  (3 
9  I sV* I sV  ♦  ? 

ITES^-IO 
1  =  0 

600  XXX=XCNT  <  I*-V  ) 

AU  =  L 

IF(ALL-XXX)20, 7729, 7729 
20  CONT IMJ  r 
C-C  TC  1 

8  CONTINUE 

500  FCRYATI I j) 

501  FCRRATI 12F5.0) 

300  FCRYAII 1H0, ! 6HLA/Y  8  NUMBER  F5.0/iH  /IH  / 56X , 4HLEF T , 3X , 5t-R IGHT , 
14X.5FLONG.  ,  6X.4HLAT.  ,2X/5H  T  IME , 4X ,4HRCLL , 3 X , 5HP I  ICH  X, 
27FFEACIMG, 5X  ,  3F  At  T  I  TUD<E,  2X  ,  8FA IR  SPE ED  »  3X  ,  3HRPM ,  4  X  ,3HRPP  , 4X  , 

38HST.  POS . , 3X , 3HST .  PQS  .  , 3 X , 4HTUR N, 3X  ,  2HG S , 5 X , 4H AL T X , 5X , 4HACEL/ 

4 1 F  /) 
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KNCCP 

LAZYY8 


-  EFN  SOURCE  STATEMENT  -  IFN { S )  - 


301  FCRMAT(F6.1t2X,F5.0,3X,F5.0,AX,F5.0,6X,F7.Ct5X,F5.C,2X,F5.0t2X, 

_„„1F5*°»6X*F5*1'6X*F5.1,2X,F5.0,IX, F6.0.1X, F5.0 ,2X ,  F6 .2 ) 

350  F0RM*T<1H1,20X,29H0ATA  PRINTOUT  FOR  FLIGHT  OF  I3.1H-I3.1H-I3/ 
l xh  / ) 


07/x 
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APPENDIX  XIV 

SAMPLE  OUTPUT  OF  LAZY  8 
EXPERIMENTAL  MEASUREMENT  PROGRAM 
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RECORDED  VALUES1 
EVENT  47  (11-20-69) 


TIME 

ROLL 

PITCH 

HEADING 

AITITUDE 

'  AIRSPEED 

0 

0 

5 

360 

9586 

200 

5 

-8 

22 

359 

9940 

185 

10 

-26 

36 

358 

10713 

156 

15 

-61 

34 

340 

11536 

118 

20 

-90 

2 

308 

11772 

101 

25 

-62 

-26 

251 

11468 

132 

30 

-29 

-21 

215 

10677 

169 

35 

-  7 

-  3 

201 

10218 

197 

40 

0 

19 

201 

10324 

182 

45 

21 

40 

218 

11030 

148 

50 

67 

41 

255 

11806 

103 

55 

82 

2 

304 

12148 

88 

60 

48 

-24 

344 

11772 

124  , 

65 

18 

-17 

358 

10996 

167 

70 

3 

-  1 

360 

10465 

193 
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FLIGHT  OF- 11/20/69 
iftVO  47  (4»LEFT  J 
AIRSPEED  CCNPUTiflONS 
W.  ERROR 

~i  o.  SUM ( 1-5 >  *  18.00 

_  _ 

3  67“  SUM(l-3»  6. 

A  -13. 00 

5  -5.00  SUMI3-5)  »  18766 


EXCURSION  TIRE  RATE 


1 


100.000  19.0 


5.3 


RESULTS  OF  ANALYSIS:  STANDARD  DEVIATION  AND  MEAN  FOR  ALL  GROUPS 


1 
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GROUP  8  GROUP 
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APPENDIX  XVI 

DEBRIEFING  PLOTS  FOR 
FOUR  LAZY  8  PERFORMANCES 
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LAZY  8 


IP  Rating:  Excellent 

Direction:  Left 


11-20-69 
ENVO-  U7 
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PITCH  (DEGREES) 
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LAZY  8 

IP  Rating:  Excellent 

Direction:  Left 


11-20-69 
ENVO-  47 


14  LEFT) 


ROLL  (DEGREES) 


AIRSPEED  (KNOTS) 
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LAZY  8 

IP  Rating:  Good 

Direction:  Left 
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LAZY  8 

IP  Rating:  Fair 

Direction:  Left 


12-19-69 
EMVO-  65 
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PITCH  (DEGREES) 
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LAZY  8 


IP  Rating: 
Direction: 


HOLDS  NOSE  UP  WITH  RUDDER  WHILE 
CONTINUING  TO  INCREASE  ROLL 
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\\  //  ZERO  PITCH  . 
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'  y  /  /  WINGS  LEVEL  ' 


REACHES  MAX 
,ROLL  BEFORE 
PITCH  BECOMES 
ZERO 


/  \ 


\  / 
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CONTINUES  TO  INCREASE 
ROLL  AFTER  PITCH 
BECOMES  ZERO 


ROLL/PITCH  COORDINATION  NOT 
SMOOTH;  ROLLS  OUT  TOO  RAPIDLY 
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LAZY  8 


IP  Rating:  Unsatisfactory 

Direction:  Left 


12-19-69 
ENVO-  66 
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APPENDIX  XVII 


DEBRIEFING  PLOTS  FOR  TWO 
BARREL  ROLL  PERFORMANCES 
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ROLL  =  -90 


ROLL-PITCH  PLOT 
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APPENDIX  XVIII 

REPRESENTATIVE  BARREL  ROLL  PLOTS 
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(PILOT'S  COMMENTS) 

"This  will  be  Barrel  Roll  No.  1,  Event  36.  The  trouble  in  barrel  rolls 
is  essentially  the  same  troubles  as  we  have  in  lazy  8's.  Student  enters 
with  the  nose  low,  gets  the  proper  parameters,  starts  his  turn  off, 
turns  back  up,  is  through  straight  and  level  flight  with  bank  still  in. 
Way  too  much  pitch  during  this  half  of  the  maneuver.  Not  enough  back 
pressure,  too  much  bank.  He  is  not  very  far  off  the  point  to  the  other 
side,  rolls  back  up  and  is  back  to  straight  and  level  flight  near  his 
original  point;  however,  if  the  whole  maneuver  were  shifted  up,  that 
would  be  a  fair  maneuver." 
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(PILOT'S  COMMENTS) 

Tu  rn  f  ^ 1 0u  r  *  reference  ^po  1  n  t  ^atrou  t^20-  30  °  6  ^Beqln^th^  P°int* 

Sc  sw's  Ei  *? 

M^-riarSiSW 
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(PILOT'S  COMMENTS) 

"This  will  be  barrel  roll  2,  event  No.  37.  This  one  again  has  the 
nose  below  the  point,  turns  off  a  given  distance,  comes  through  straight 
and  level  flight.  Gets  a  pretty  fair  start  of  the  thing,  not  enough 
back  pressure  during  the  first  part,  consequently  the  first  half  of  the 
maneuver  is  flattened  out;  he  has  to  roll  much  tod  rapidly  to  get  his 
nose  through  at  the  proper  attitude.  He  continues  tor  roll  too  fast  and 
winds  up  flattening  out  the  bottom  part  of  the  maneuver.  He  has  basic 
idea  that  he  is  flattening  it  out  too  much." 
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(PILOT'S  COMMENTS) 

Barrel  roll  5,  event  No.  40.  Nose  below  the  point  coming  up  on  our 
entry  airspeed;  In  this  one  again  you  have  got  the  real  tiger  flying  the 
airplane.  Basically  a  little  too  aggressive  with  it.  He  Is  pretty 
smooth  with  the  controls.  But  he  flies  a  very  tight,  very  aggressive 
barrel  roll  which  Is  fine  as  far  as  aggressiveness  goes  but  It  does  not 
quite  look  like  a  barrel  roll  Is  supposed  to  look,  and  that  would  be  a 
fair  maneuver." 
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(PILOT'S  COMMENTS) 

"Nose  below  the  point  entering,  turns  off  much  too  far,  back  through 
not  in  straight  and  level  flight,  essentially  winds  up  flying  a  loop 
around  his  point.  The  nose  is  much  too  far  off  the  point;  a  little 
bit  of  burble  on  the  top  and  we  are  back  up.  However  we  are  about  60 
or  70°  off  our  point,  and  that  would  be  an  unsatisfactory  maneuver  also." 
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(PILOT'S  COMMENTS) 

Turn  back  aroijrd  to  the  west.  This  will  be  barrel  roll  No.  9,  event 
no.  bt.  This  is  the  student  who  makes  a  reasonably  good  entry  for  the 
maneuver.  Rolls  the  nose  around  his  point,  turns  off,  and  then  starts 
to  roll  initially  with  way  too  much  back  pressure  and  then  just  rolls 
easing  up  on  the  back  pressure.  As  a  result  the  nose  never  quite  qets 
back  to  the  horizon  at  all  and  you  wind  up  at  the  original  entry  point. 
However,  you  have  never  descended  at  all  and  never  made  the  lower  part 
of  the  maneuver  look  anything  like  it's  supposed  to  look.  That  would 
have  been  an  unsatisfactory." 
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(PILOT'S  COMMENTS) 
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(PILOT'S  COMMENTS) 

rI5iS*4111ube  b?:rel  ro11  No-  5*  event  57.  Nose  below  the  point  off 
This  time  he  rolls  much  too  fast  to  start  with.  He  is  flattening  out 
«ie  maneuver  much  too  much  across  the  top.  The  nose  is  off  the  far  side 
about  as  far  as  it  should  be,  however,  in  here  he  is  not  rollinq  off 

delate  hS°SI9Ma!Id  9  °Ut  0f  10  cases*  he  wil1  wind  UP  ^at  we 

unsatisfactory. "  9h  SP  cvve  recovery*  That  would  have  been 
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12-19-39 
ENVO-  57 
fl  LEFT) 


(PILOT'S  COMMENTS) 


"The  barrel  roll  is  much  easier  to  mess  up  on  the  entry  than  even  this 
one  Is.  This  one  will  be  barrel  roll  10,  event  69.  Driving  around 
he  wants  to  do  a  barrel  roll,  again  they  just  make  up  their  mind.  The 
airspeed  is  already  230  knots  as  a  maximum  entry  airspeed.  They  pick 
out  their  point,  lower  the  nose  below  the  point.  The  airspeed  Is 
already  240.  Then  they  lower  the  nose,  start  to  ao  the  maneuver, 
come  up  with  much  too  much  airspeed,  250,  260,  270,  they  worry  about 
the  airspeed,  getting  the  nose  way  up  too  high.  Generally  disorganized. 
That  would  have  been  an  unsatisfactory." 
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(PILOT'S  COMMENTS) 


"The  most  common  tendency  on  the  barrel  roll  for  an  unsatisfactory 
maneuver  is  what  we  are  about  to  do,  barre1  roll  No.  8,  event  No  61 
and  that  is  flattening  out  across  the  top  like  we  have  shown  before,  ’ 
with  the  rate  of  roll  a  little  too  slow  in  the  second  quadrant,  windinq 
up  coming  through  the  ncrizon  with  bank  still  and  the  nose  coming  much 
too  low.  Winding  up  with  essentially  a  high  speed  dive  recovery. 

And  I  am  getting  myself  into  an  area,  headingwise,  that  I  should  not 
oe  in  on  those. 
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